OrbitGrasp: $SE(3)$-Equivariant Grasp Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hu, Boce, Zhu, Xupeng, Wang, Dian, Dong, Zihao, Huang, Haojie, Wang, Chenghao, Walters, Robin, Platt, Robert
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909380168908800
author Hu, Boce
Zhu, Xupeng
Wang, Dian
Dong, Zihao
Huang, Haojie
Wang, Chenghao
Walters, Robin
Platt, Robert
author_facet Hu, Boce
Zhu, Xupeng
Wang, Dian
Dong, Zihao
Huang, Haojie
Wang, Chenghao
Walters, Robin
Platt, Robert
contents While grasp detection is an important part of any robotic manipulation pipeline, reliable and accurate grasp detection in $SE(3)$ remains a research challenge. Many robotics applications in unstructured environments such as the home or warehouse would benefit a lot from better grasp performance. This paper proposes a novel framework for detecting $SE(3)$ grasp poses based on point cloud input. Our main contribution is to propose an $SE(3)$-equivariant model that maps each point in the cloud to a continuous grasp quality function over the 2-sphere $S^2$ using spherical harmonic basis functions. Compared with reasoning about a finite set of samples, this formulation improves the accuracy and efficiency of our model when a large number of samples would otherwise be needed. In order to accomplish this, we propose a novel variation on EquiFormerV2 that leverages a UNet-style encoder-decoder architecture to enlarge the number of points the model can handle. Our resulting method, which we name $\textit{OrbitGrasp}$, significantly outperforms baselines in both simulation and physical experiments.
format Preprint
id arxiv_https___arxiv_org_abs_2407_03531
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle OrbitGrasp: $SE(3)$-Equivariant Grasp Learning
Hu, Boce
Zhu, Xupeng
Wang, Dian
Dong, Zihao
Huang, Haojie
Wang, Chenghao
Walters, Robin
Platt, Robert
Robotics
While grasp detection is an important part of any robotic manipulation pipeline, reliable and accurate grasp detection in $SE(3)$ remains a research challenge. Many robotics applications in unstructured environments such as the home or warehouse would benefit a lot from better grasp performance. This paper proposes a novel framework for detecting $SE(3)$ grasp poses based on point cloud input. Our main contribution is to propose an $SE(3)$-equivariant model that maps each point in the cloud to a continuous grasp quality function over the 2-sphere $S^2$ using spherical harmonic basis functions. Compared with reasoning about a finite set of samples, this formulation improves the accuracy and efficiency of our model when a large number of samples would otherwise be needed. In order to accomplish this, we propose a novel variation on EquiFormerV2 that leverages a UNet-style encoder-decoder architecture to enlarge the number of points the model can handle. Our resulting method, which we name $\textit{OrbitGrasp}$, significantly outperforms baselines in both simulation and physical experiments.
title OrbitGrasp: $SE(3)$-Equivariant Grasp Learning
topic Robotics
url https://arxiv.org/abs/2407.03531