AVR: Active Vision-Driven Precise Robot Manipulation with Viewpoint and Focal Length Optimization
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916971008753664 |
|---|---|
| author | Liu, Yushan Mu, Shilong Chao, Xintao Li, Zizhen Mu, Yao Chen, Tianxing Li, Shoujie Lyu, Chuqiao Zhang, Xiao-Ping Ding, Wenbo |
| author_facet | Liu, Yushan Mu, Shilong Chao, Xintao Li, Zizhen Mu, Yao Chen, Tianxing Li, Shoujie Lyu, Chuqiao Zhang, Xiao-Ping Ding, Wenbo |
| contents | Robotic manipulation in complex scenes demands precise perception of task-relevant details, yet fixed or suboptimal viewpoints often impair fine-grained perception and induce occlusions, constraining imitation-learned policies. We present AVR (Active Vision-driven Robotics), a bimanual teleoperation and learning framework that unifies head-tracked viewpoint control (HMD-to-2-DoF gimbal) with motorized optical zoom to keep targets centered at an appropriate scale during data collection and deployment. In simulation, an AVR plugin augments RoboTwin demonstrations by emulating active vision (ROI-conditioned viewpoint change, aspect-ratio-preserving crops with explicit zoom ratios, and super-resolution), yielding 5-17% gains in task success across diverse manipulations. On our real-world platform, AVR improves success on most tasks, with over 25% gains compared to the static-view baseline, and extended studies further demonstrate robustness under occlusion, clutter, and lighting disturbances, as well as generalization to unseen environments and objects. These results pave the way for future robotic precision manipulation methods in the pursuit of human-level dexterity and precision. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_01439 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AVR: Active Vision-Driven Precise Robot Manipulation with Viewpoint and Focal Length Optimization Liu, Yushan Mu, Shilong Chao, Xintao Li, Zizhen Mu, Yao Chen, Tianxing Li, Shoujie Lyu, Chuqiao Zhang, Xiao-Ping Ding, Wenbo Robotics Robotic manipulation in complex scenes demands precise perception of task-relevant details, yet fixed or suboptimal viewpoints often impair fine-grained perception and induce occlusions, constraining imitation-learned policies. We present AVR (Active Vision-driven Robotics), a bimanual teleoperation and learning framework that unifies head-tracked viewpoint control (HMD-to-2-DoF gimbal) with motorized optical zoom to keep targets centered at an appropriate scale during data collection and deployment. In simulation, an AVR plugin augments RoboTwin demonstrations by emulating active vision (ROI-conditioned viewpoint change, aspect-ratio-preserving crops with explicit zoom ratios, and super-resolution), yielding 5-17% gains in task success across diverse manipulations. On our real-world platform, AVR improves success on most tasks, with over 25% gains compared to the static-view baseline, and extended studies further demonstrate robustness under occlusion, clutter, and lighting disturbances, as well as generalization to unseen environments and objects. These results pave the way for future robotic precision manipulation methods in the pursuit of human-level dexterity and precision. |
| title | AVR: Active Vision-Driven Precise Robot Manipulation with Viewpoint and Focal Length Optimization |
| topic | Robotics |
| url | https://arxiv.org/abs/2503.01439 |