CenterArt: Joint Shape Reconstruction and 6-DoF Grasp Estimation of Articulated Objects
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916219633795072 |
|---|---|
| author | Mokhtar, Sassan Chisari, Eugenio Heppert, Nick Valada, Abhinav |
| author_facet | Mokhtar, Sassan Chisari, Eugenio Heppert, Nick Valada, Abhinav |
| contents | Precisely grasping and reconstructing articulated objects is key to enabling general robotic manipulation. In this paper, we propose CenterArt, a novel approach for simultaneous 3D shape reconstruction and 6-DoF grasp estimation of articulated objects. CenterArt takes RGB-D images of the scene as input and first predicts the shape and joint codes through an encoder. The decoder then leverages these codes to reconstruct 3D shapes and estimate 6-DoF grasp poses of the objects. We further develop a mechanism for generating a dataset of 6-DoF grasp ground truth poses for articulated objects. CenterArt is trained on realistic scenes containing multiple articulated objects with randomized designs, textures, lighting conditions, and realistic depths. We perform extensive experiments demonstrating that CenterArt outperforms existing methods in accuracy and robustness. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_14968 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CenterArt: Joint Shape Reconstruction and 6-DoF Grasp Estimation of Articulated Objects Mokhtar, Sassan Chisari, Eugenio Heppert, Nick Valada, Abhinav Robotics Computer Vision and Pattern Recognition Precisely grasping and reconstructing articulated objects is key to enabling general robotic manipulation. In this paper, we propose CenterArt, a novel approach for simultaneous 3D shape reconstruction and 6-DoF grasp estimation of articulated objects. CenterArt takes RGB-D images of the scene as input and first predicts the shape and joint codes through an encoder. The decoder then leverages these codes to reconstruct 3D shapes and estimate 6-DoF grasp poses of the objects. We further develop a mechanism for generating a dataset of 6-DoF grasp ground truth poses for articulated objects. CenterArt is trained on realistic scenes containing multiple articulated objects with randomized designs, textures, lighting conditions, and realistic depths. We perform extensive experiments demonstrating that CenterArt outperforms existing methods in accuracy and robustness. |
| title | CenterArt: Joint Shape Reconstruction and 6-DoF Grasp Estimation of Articulated Objects |
| topic | Robotics Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.14968 |