Visuo-Tactile based Predictive Cross Modal Perception for Object Exploration in Robotics
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917673439330304 |
|---|---|
| author | Dutta, Anirvan Burdet, Etienne Kaboli, Mohsen |
| author_facet | Dutta, Anirvan Burdet, Etienne Kaboli, Mohsen |
| contents | Autonomously exploring the unknown physical properties of novel objects such as stiffness, mass, center of mass, friction coefficient, and shape is crucial for autonomous robotic systems operating continuously in unstructured environments. We introduce a novel visuo-tactile based predictive cross-modal perception framework where initial visual observations (shape) aid in obtaining an initial prior over the object properties (mass). The initial prior improves the efficiency of the object property estimation, which is autonomously inferred via interactive non-prehensile pushing and using a dual filtering approach. The inferred properties are then used to enhance the predictive capability of the cross-modal function efficiently by using a human-inspired `surprise' formulation. We evaluated our proposed framework in the real-robotic scenario, demonstrating superior performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_12634 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Visuo-Tactile based Predictive Cross Modal Perception for Object Exploration in Robotics Dutta, Anirvan Burdet, Etienne Kaboli, Mohsen Robotics Autonomously exploring the unknown physical properties of novel objects such as stiffness, mass, center of mass, friction coefficient, and shape is crucial for autonomous robotic systems operating continuously in unstructured environments. We introduce a novel visuo-tactile based predictive cross-modal perception framework where initial visual observations (shape) aid in obtaining an initial prior over the object properties (mass). The initial prior improves the efficiency of the object property estimation, which is autonomously inferred via interactive non-prehensile pushing and using a dual filtering approach. The inferred properties are then used to enhance the predictive capability of the cross-modal function efficiently by using a human-inspired `surprise' formulation. We evaluated our proposed framework in the real-robotic scenario, demonstrating superior performance. |
| title | Visuo-Tactile based Predictive Cross Modal Perception for Object Exploration in Robotics |
| topic | Robotics |
| url | https://arxiv.org/abs/2405.12634 |