DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916495469051904 |
|---|---|
| author | Lee, Kang-Won Qin, Yuzhe Wang, Xiaolong Lim, Soo-Chul |
| author_facet | Lee, Kang-Won Qin, Yuzhe Wang, Xiaolong Lim, Soo-Chul |
| contents | The sense of touch is an essential ability for skillfully performing a variety of tasks, providing the capacity to search and manipulate objects without relying on visual information. In this paper, we introduce a multi-finger robot system designed to manipulate objects using the sense of touch, without relying on vision. For tasks that mimic daily life, the robot uses its sense of touch to manipulate randomly placed objects in dark. The objective of this study is to enable robots to perform blind manipulation by using tactile sensation to compensate for the information gap caused by the absence of vision, given the presence of prior information. Training the policy through reinforcement learning in simulation and transferring the trained policy to the real environment, we demonstrate that blind manipulation can be applied to robots without vision. In addition, the experiments showcase the importance of tactile sensing in the blind manipulation tasks. Our project page is available at https://lee-kangwon.github.io/dextouch/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_12496 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity Lee, Kang-Won Qin, Yuzhe Wang, Xiaolong Lim, Soo-Chul Robotics Machine Learning The sense of touch is an essential ability for skillfully performing a variety of tasks, providing the capacity to search and manipulate objects without relying on visual information. In this paper, we introduce a multi-finger robot system designed to manipulate objects using the sense of touch, without relying on vision. For tasks that mimic daily life, the robot uses its sense of touch to manipulate randomly placed objects in dark. The objective of this study is to enable robots to perform blind manipulation by using tactile sensation to compensate for the information gap caused by the absence of vision, given the presence of prior information. Training the policy through reinforcement learning in simulation and transferring the trained policy to the real environment, we demonstrate that blind manipulation can be applied to robots without vision. In addition, the experiments showcase the importance of tactile sensing in the blind manipulation tasks. Our project page is available at https://lee-kangwon.github.io/dextouch/ |
| title | DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity |
| topic | Robotics Machine Learning |
| url | https://arxiv.org/abs/2401.12496 |