Residual Rotation Correction using Tactile Equivariance
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909897575104512 |
|---|---|
| author | Zhu, Yizhe Ye, Zhang Hu, Boce Zhao, Haibo Qi, Yu Wang, Dian Platt, Robert |
| author_facet | Zhu, Yizhe Ye, Zhang Hu, Boce Zhao, Haibo Qi, Yu Wang, Dian Platt, Robert |
| contents | Visuotactile policy learning augments vision-only policies with tactile input, facilitating contact-rich manipulation. However, the high cost of tactile data collection makes sample efficiency the key requirement for developing visuotactile policies. We present EquiTac, a framework that exploits the inherent SO(2) symmetry of in-hand object rotation to improve sample efficiency and generalization for visuotactile policy learning. EquiTac first reconstructs surface normals from raw RGB inputs of vision-based tactile sensors, so rotations of the normal vector field correspond to in-hand object rotations. An SO(2)-equivariant network then predicts a residual rotation action that augments a base visuomotor policy at test time, enabling real-time rotation correction without additional reorientation demonstrations. On a real robot, EquiTac accurately achieves robust zero-shot generalization to unseen in-hand orientations with very few training samples, where baselines fail even with more training data. To our knowledge, this is the first tactile learning method to explicitly encode tactile equivariance for policy learning, yielding a lightweight, symmetry-aware module that improves reliability in contact-rich tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_07381 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Residual Rotation Correction using Tactile Equivariance Zhu, Yizhe Ye, Zhang Hu, Boce Zhao, Haibo Qi, Yu Wang, Dian Platt, Robert Robotics 14J60 (Primary) 14F05, 14J26 (Secondary), 14J60 (Primary) 14F05, 14J26 (Secondary) Visuotactile policy learning augments vision-only policies with tactile input, facilitating contact-rich manipulation. However, the high cost of tactile data collection makes sample efficiency the key requirement for developing visuotactile policies. We present EquiTac, a framework that exploits the inherent SO(2) symmetry of in-hand object rotation to improve sample efficiency and generalization for visuotactile policy learning. EquiTac first reconstructs surface normals from raw RGB inputs of vision-based tactile sensors, so rotations of the normal vector field correspond to in-hand object rotations. An SO(2)-equivariant network then predicts a residual rotation action that augments a base visuomotor policy at test time, enabling real-time rotation correction without additional reorientation demonstrations. On a real robot, EquiTac accurately achieves robust zero-shot generalization to unseen in-hand orientations with very few training samples, where baselines fail even with more training data. To our knowledge, this is the first tactile learning method to explicitly encode tactile equivariance for policy learning, yielding a lightweight, symmetry-aware module that improves reliability in contact-rich tasks. |
| title | Residual Rotation Correction using Tactile Equivariance |
| topic | Robotics 14J60 (Primary) 14F05, 14J26 (Secondary), 14J60 (Primary) 14F05, 14J26 (Secondary) |
| url | https://arxiv.org/abs/2511.07381 |