Learning In-Hand Translation Using Tactile Skin With Shear and Normal Force Sensing
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908370825379840 |
|---|---|
| author | Yin, Jessica Qi, Haozhi Malik, Jitendra Pikul, James Yim, Mark Hellebrekers, Tess |
| author_facet | Yin, Jessica Qi, Haozhi Malik, Jitendra Pikul, James Yim, Mark Hellebrekers, Tess |
| contents | Recent progress in reinforcement learning (RL) and tactile sensing has significantly advanced dexterous manipulation. However, these methods often utilize simplified tactile signals due to the gap between tactile simulation and the real world. We introduce a sensor model for tactile skin that enables zero-shot sim-to-real transfer of ternary shear and binary normal forces. Using this model, we develop an RL policy that leverages sliding contact for dexterous in-hand translation. We conduct extensive real-world experiments to assess how tactile sensing facilitates policy adaptation to various unseen object properties and robot hand orientations. We demonstrate that our 3-axis tactile policies consistently outperform baselines that use only shear forces, only normal forces, or only proprioception. Website: https://jessicayin.github.io/tactile-skin-rl/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_07885 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Learning In-Hand Translation Using Tactile Skin With Shear and Normal Force Sensing Yin, Jessica Qi, Haozhi Malik, Jitendra Pikul, James Yim, Mark Hellebrekers, Tess Robotics Machine Learning Recent progress in reinforcement learning (RL) and tactile sensing has significantly advanced dexterous manipulation. However, these methods often utilize simplified tactile signals due to the gap between tactile simulation and the real world. We introduce a sensor model for tactile skin that enables zero-shot sim-to-real transfer of ternary shear and binary normal forces. Using this model, we develop an RL policy that leverages sliding contact for dexterous in-hand translation. We conduct extensive real-world experiments to assess how tactile sensing facilitates policy adaptation to various unseen object properties and robot hand orientations. We demonstrate that our 3-axis tactile policies consistently outperform baselines that use only shear forces, only normal forces, or only proprioception. Website: https://jessicayin.github.io/tactile-skin-rl/ |
| title | Learning In-Hand Translation Using Tactile Skin With Shear and Normal Force Sensing |
| topic | Robotics Machine Learning |
| url | https://arxiv.org/abs/2407.07885 |