Articulated Object Manipulation using Online Axis Estimation with SAM2-Based Tracking
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917947253981184 |
|---|---|
| author | Wang, Xi Chen, Tianxing Yu, Qiaojun Xu, Tianling Chen, Zanxin Fu, Yiting He, Ziqi Lu, Cewu Mu, Yao Luo, Ping |
| author_facet | Wang, Xi Chen, Tianxing Yu, Qiaojun Xu, Tianling Chen, Zanxin Fu, Yiting He, Ziqi Lu, Cewu Mu, Yao Luo, Ping |
| contents | Articulated object manipulation requires precise object interaction, where the object's axis must be carefully considered. Previous research employed interactive perception for manipulating articulated objects, but typically, open-loop approaches often suffer from overlooking the interaction dynamics. To address this limitation, we present a closed-loop pipeline integrating interactive perception with online axis estimation from segmented 3D point clouds. Our method leverages any interactive perception technique as a foundation for interactive perception, inducing slight object movement to generate point cloud frames of the evolving dynamic scene. These point clouds are then segmented using Segment Anything Model 2 (SAM2), after which the moving part of the object is masked for accurate motion online axis estimation, guiding subsequent robotic actions. Our approach significantly enhances the precision and efficiency of manipulation tasks involving articulated objects. Experiments in simulated environments demonstrate that our method outperforms baseline approaches, especially in tasks that demand precise axis-based control. Project Page: https://hytidel.github.io/video-tracking-for-axis-estimation/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_16287 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Articulated Object Manipulation using Online Axis Estimation with SAM2-Based Tracking Wang, Xi Chen, Tianxing Yu, Qiaojun Xu, Tianling Chen, Zanxin Fu, Yiting He, Ziqi Lu, Cewu Mu, Yao Luo, Ping Robotics Artificial Intelligence Graphics Machine Learning Articulated object manipulation requires precise object interaction, where the object's axis must be carefully considered. Previous research employed interactive perception for manipulating articulated objects, but typically, open-loop approaches often suffer from overlooking the interaction dynamics. To address this limitation, we present a closed-loop pipeline integrating interactive perception with online axis estimation from segmented 3D point clouds. Our method leverages any interactive perception technique as a foundation for interactive perception, inducing slight object movement to generate point cloud frames of the evolving dynamic scene. These point clouds are then segmented using Segment Anything Model 2 (SAM2), after which the moving part of the object is masked for accurate motion online axis estimation, guiding subsequent robotic actions. Our approach significantly enhances the precision and efficiency of manipulation tasks involving articulated objects. Experiments in simulated environments demonstrate that our method outperforms baseline approaches, especially in tasks that demand precise axis-based control. Project Page: https://hytidel.github.io/video-tracking-for-axis-estimation/. |
| title | Articulated Object Manipulation using Online Axis Estimation with SAM2-Based Tracking |
| topic | Robotics Artificial Intelligence Graphics Machine Learning |
| url | https://arxiv.org/abs/2409.16287 |