Tactile-based Object Retrieval From Granular Media
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866918259764232192 |
|---|---|
| author | Xu, Jingxi Jia, Yinsen Yang, Dongxiao Meng, Patrick Zhu, Xinyue Guo, Zihan Song, Shuran Ciocarlie, Matei |
| author_facet | Xu, Jingxi Jia, Yinsen Yang, Dongxiao Meng, Patrick Zhu, Xinyue Guo, Zihan Song, Shuran Ciocarlie, Matei |
| contents | We introduce GEOTACT, the first robotic system capable of grasping and retrieving objects of potentially unknown shapes buried in a granular environment. While important in many applications, ranging from mining and exploration to search and rescue, this type of interaction with granular media is difficult due to the uncertainty stemming from visual occlusion and noisy contact signals. To address these challenges, we use a learning method relying exclusively on touch feedback, trained end-to-end with simulated sensor noise. We show that our problem formulation leads to the natural emergence of learned pushing behaviors that the manipulator uses to reduce uncertainty and funnel the object to a stable grasp despite spurious and noisy tactile readings. We introduce a training curriculum that bootstraps learning in simulated granular environments, enabling zero-shot transfer to real hardware. Despite being trained only on seven objects with primitive shapes, our method is shown to successfully retrieve 35 different objects, including rigid, deformable, and articulated objects with complex shapes. Videos and additional information can be found at https://jxu.ai/geotact. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_04536 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Tactile-based Object Retrieval From Granular Media Xu, Jingxi Jia, Yinsen Yang, Dongxiao Meng, Patrick Zhu, Xinyue Guo, Zihan Song, Shuran Ciocarlie, Matei Robotics Artificial Intelligence Machine Learning We introduce GEOTACT, the first robotic system capable of grasping and retrieving objects of potentially unknown shapes buried in a granular environment. While important in many applications, ranging from mining and exploration to search and rescue, this type of interaction with granular media is difficult due to the uncertainty stemming from visual occlusion and noisy contact signals. To address these challenges, we use a learning method relying exclusively on touch feedback, trained end-to-end with simulated sensor noise. We show that our problem formulation leads to the natural emergence of learned pushing behaviors that the manipulator uses to reduce uncertainty and funnel the object to a stable grasp despite spurious and noisy tactile readings. We introduce a training curriculum that bootstraps learning in simulated granular environments, enabling zero-shot transfer to real hardware. Despite being trained only on seven objects with primitive shapes, our method is shown to successfully retrieve 35 different objects, including rigid, deformable, and articulated objects with complex shapes. Videos and additional information can be found at https://jxu.ai/geotact. |
| title | Tactile-based Object Retrieval From Granular Media |
| topic | Robotics Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2402.04536 |