Saved in:
Bibliographic Details
Main Authors: Butterfield, Daniel, Garimella, Sandilya Sai, Cheng, Nai-Jen, Gan, Lu
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.11146
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916672338657280
author Butterfield, Daniel
Garimella, Sandilya Sai
Cheng, Nai-Jen
Gan, Lu
author_facet Butterfield, Daniel
Garimella, Sandilya Sai
Cheng, Nai-Jen
Gan, Lu
contents We present a Morphology-Informed Heterogeneous Graph Neural Network (MI-HGNN) for learning-based contact perception. The architecture and connectivity of the MI-HGNN are constructed from the robot morphology, in which nodes and edges are robot joints and links, respectively. By incorporating the morphology-informed constraints into a neural network, we improve a learning-based approach using model-based knowledge. We apply the proposed MI-HGNN to two contact perception problems, and conduct extensive experiments using both real-world and simulated data collected using two quadruped robots. Our experiments demonstrate the superiority of our method in terms of effectiveness, generalization ability, model efficiency, and sample efficiency. Our MI-HGNN improved the performance of a state-of-the-art model that leverages robot morphological symmetry by 8.4% with only 0.21% of its parameters. Although MI-HGNN is applied to contact perception problems for legged robots in this work, it can be seamlessly applied to other types of multi-body dynamical systems and has the potential to improve other robot learning frameworks. Our code is made publicly available at https://github.com/lunarlab-gatech/Morphology-Informed-HGNN.
format Preprint
id arxiv_https___arxiv_org_abs_2409_11146
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MI-HGNN: Morphology-Informed Heterogeneous Graph Neural Network for Legged Robot Contact Perception
Butterfield, Daniel
Garimella, Sandilya Sai
Cheng, Nai-Jen
Gan, Lu
Robotics
E.1; I.2.6; I.2.9; J.2
We present a Morphology-Informed Heterogeneous Graph Neural Network (MI-HGNN) for learning-based contact perception. The architecture and connectivity of the MI-HGNN are constructed from the robot morphology, in which nodes and edges are robot joints and links, respectively. By incorporating the morphology-informed constraints into a neural network, we improve a learning-based approach using model-based knowledge. We apply the proposed MI-HGNN to two contact perception problems, and conduct extensive experiments using both real-world and simulated data collected using two quadruped robots. Our experiments demonstrate the superiority of our method in terms of effectiveness, generalization ability, model efficiency, and sample efficiency. Our MI-HGNN improved the performance of a state-of-the-art model that leverages robot morphological symmetry by 8.4% with only 0.21% of its parameters. Although MI-HGNN is applied to contact perception problems for legged robots in this work, it can be seamlessly applied to other types of multi-body dynamical systems and has the potential to improve other robot learning frameworks. Our code is made publicly available at https://github.com/lunarlab-gatech/Morphology-Informed-HGNN.
title MI-HGNN: Morphology-Informed Heterogeneous Graph Neural Network for Legged Robot Contact Perception
topic Robotics
E.1; I.2.6; I.2.9; J.2
url https://arxiv.org/abs/2409.11146