GAPartManip: A Large-scale Part-centric Dataset for Material-Agnostic Articulated Object Manipulation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916658635866112 |
|---|---|
| author | Cui, Wenbo Zhao, Chengyang Wei, Songlin Zhang, Jiazhao Geng, Haoran Chen, Yaran Li, Haoran Wang, He |
| author_facet | Cui, Wenbo Zhao, Chengyang Wei, Songlin Zhang, Jiazhao Geng, Haoran Chen, Yaran Li, Haoran Wang, He |
| contents | Effectively manipulating articulated objects in household scenarios is a crucial step toward achieving general embodied artificial intelligence. Mainstream research in 3D vision has primarily focused on manipulation through depth perception and pose detection. However, in real-world environments, these methods often face challenges due to imperfect depth perception, such as with transparent lids and reflective handles. Moreover, they generally lack the diversity in part-based interactions required for flexible and adaptable manipulation. To address these challenges, we introduced a large-scale part-centric dataset for articulated object manipulation that features both photo-realistic material randomization and detailed annotations of part-oriented, scene-level actionable interaction poses. We evaluated the effectiveness of our dataset by integrating it with several state-of-the-art methods for depth estimation and interaction pose prediction. Additionally, we proposed a novel modular framework that delivers superior and robust performance for generalizable articulated object manipulation. Our extensive experiments demonstrate that our dataset significantly improves the performance of depth perception and actionable interaction pose prediction in both simulation and real-world scenarios. More information and demos can be found at: https://pku-epic.github.io/GAPartManip/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_18276 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | GAPartManip: A Large-scale Part-centric Dataset for Material-Agnostic Articulated Object Manipulation Cui, Wenbo Zhao, Chengyang Wei, Songlin Zhang, Jiazhao Geng, Haoran Chen, Yaran Li, Haoran Wang, He Robotics Artificial Intelligence Effectively manipulating articulated objects in household scenarios is a crucial step toward achieving general embodied artificial intelligence. Mainstream research in 3D vision has primarily focused on manipulation through depth perception and pose detection. However, in real-world environments, these methods often face challenges due to imperfect depth perception, such as with transparent lids and reflective handles. Moreover, they generally lack the diversity in part-based interactions required for flexible and adaptable manipulation. To address these challenges, we introduced a large-scale part-centric dataset for articulated object manipulation that features both photo-realistic material randomization and detailed annotations of part-oriented, scene-level actionable interaction poses. We evaluated the effectiveness of our dataset by integrating it with several state-of-the-art methods for depth estimation and interaction pose prediction. Additionally, we proposed a novel modular framework that delivers superior and robust performance for generalizable articulated object manipulation. Our extensive experiments demonstrate that our dataset significantly improves the performance of depth perception and actionable interaction pose prediction in both simulation and real-world scenarios. More information and demos can be found at: https://pku-epic.github.io/GAPartManip/. |
| title | GAPartManip: A Large-scale Part-centric Dataset for Material-Agnostic Articulated Object Manipulation |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2411.18276 |