Stiffness Copilot: An Impedance Policy for Contact-Rich Teleoperation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917342159568896 |
|---|---|
| author | Wang, Yeping Xu, Zhengtong Preechayasomboon, Pornthep Abbatematteo, Ben Memar, Amirhossein H. Colonnese, Nick Chan, Sonny |
| author_facet | Wang, Yeping Xu, Zhengtong Preechayasomboon, Pornthep Abbatematteo, Ben Memar, Amirhossein H. Colonnese, Nick Chan, Sonny |
| contents | In teleoperation of contact-rich manipulation tasks, selecting robot impedance is critical but difficult. The robot must be compliant to avoid damaging the environment, but stiff to remain responsive and to apply force when needed. In this paper, we present Stiffness Copilot, a vision-based policy for shared-control teleoperation in which the operator commands robot pose and the policy adjusts robot impedance online. To train Stiffness Copilot, we first infer direction-dependent stiffness matrices in simulation using privileged contact information. We then use these matrices to supervise a lightweight vision policy that predicts robot stiffness from wrist-camera images and transfers zero-shot to real images at runtime. In a human-subject study, Stiffness Copilot achieved safety comparable to using a constant low stiffness while matching the efficiency of using a constant high stiffness. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_14068 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Stiffness Copilot: An Impedance Policy for Contact-Rich Teleoperation Wang, Yeping Xu, Zhengtong Preechayasomboon, Pornthep Abbatematteo, Ben Memar, Amirhossein H. Colonnese, Nick Chan, Sonny Robotics In teleoperation of contact-rich manipulation tasks, selecting robot impedance is critical but difficult. The robot must be compliant to avoid damaging the environment, but stiff to remain responsive and to apply force when needed. In this paper, we present Stiffness Copilot, a vision-based policy for shared-control teleoperation in which the operator commands robot pose and the policy adjusts robot impedance online. To train Stiffness Copilot, we first infer direction-dependent stiffness matrices in simulation using privileged contact information. We then use these matrices to supervise a lightweight vision policy that predicts robot stiffness from wrist-camera images and transfers zero-shot to real images at runtime. In a human-subject study, Stiffness Copilot achieved safety comparable to using a constant low stiffness while matching the efficiency of using a constant high stiffness. |
| title | Stiffness Copilot: An Impedance Policy for Contact-Rich Teleoperation |
| topic | Robotics |
| url | https://arxiv.org/abs/2603.14068 |