Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2412.10631 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917868426231808 |
|---|---|
| author | Nechyporenko, Nataliya Hoque, Ryan Webb, Christopher Sivapurapu, Mouli Zhang, Jian |
| author_facet | Nechyporenko, Nataliya Hoque, Ryan Webb, Christopher Sivapurapu, Mouli Zhang, Jian |
| contents | Teleoperation for robot imitation learning is bottlenecked by hardware availability. Can high-quality robot data be collected without a physical robot? We present a system for augmenting Apple Vision Pro with real-time virtual robot feedback. By providing users with an intuitive understanding of how their actions translate to robot motions, we enable the collection of natural barehanded human data that is compatible with the limitations of physical robot hardware. We conducted a user study with 15 participants demonstrating 3 different tasks each under 3 different feedback conditions and directly replayed the collected trajectories on physical robot hardware. Results suggest live robot feedback dramatically improves the quality of the collected data, suggesting a new avenue for scalable human data collection without access to robot hardware. Videos and more are available at https://nataliya.dev/armada. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_10631 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ARMADA: Augmented Reality for Robot Manipulation and Robot-Free Data Acquisition Nechyporenko, Nataliya Hoque, Ryan Webb, Christopher Sivapurapu, Mouli Zhang, Jian Robotics Teleoperation for robot imitation learning is bottlenecked by hardware availability. Can high-quality robot data be collected without a physical robot? We present a system for augmenting Apple Vision Pro with real-time virtual robot feedback. By providing users with an intuitive understanding of how their actions translate to robot motions, we enable the collection of natural barehanded human data that is compatible with the limitations of physical robot hardware. We conducted a user study with 15 participants demonstrating 3 different tasks each under 3 different feedback conditions and directly replayed the collected trajectories on physical robot hardware. Results suggest live robot feedback dramatically improves the quality of the collected data, suggesting a new avenue for scalable human data collection without access to robot hardware. Videos and more are available at https://nataliya.dev/armada. |
| title | ARMADA: Augmented Reality for Robot Manipulation and Robot-Free Data Acquisition |
| topic | Robotics |
| url | https://arxiv.org/abs/2412.10631 |