ACE: A Cross-Platform Visual-Exoskeletons System for Low-Cost Dexterous Teleoperation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929468180791296 |
|---|---|
| author | Yang, Shiqi Liu, Minghuan Qin, Yuzhe Ding, Runyu Li, Jialong Cheng, Xuxin Yang, Ruihan Yi, Sha Wang, Xiaolong |
| author_facet | Yang, Shiqi Liu, Minghuan Qin, Yuzhe Ding, Runyu Li, Jialong Cheng, Xuxin Yang, Ruihan Yi, Sha Wang, Xiaolong |
| contents | Learning from demonstrations has shown to be an effective approach to robotic manipulation, especially with the recently collected large-scale robot data with teleoperation systems. Building an efficient teleoperation system across diverse robot platforms has become more crucial than ever. However, there is a notable lack of cost-effective and user-friendly teleoperation systems for different end-effectors, e.g., anthropomorphic robot hands and grippers, that can operate across multiple platforms. To address this issue, we develop ACE, a cross-platform visual-exoskeleton system for low-cost dexterous teleoperation. Our system utilizes a hand-facing camera to capture 3D hand poses and an exoskeleton mounted on a portable base, enabling accurate real-time capture of both finger and wrist poses. Compared to previous systems, which often require hardware customization according to different robots, our single system can generalize to humanoid hands, arm-hands, arm-gripper, and quadruped-gripper systems with high-precision teleoperation. This enables imitation learning for complex manipulation tasks on diverse platforms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_11805 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ACE: A Cross-Platform Visual-Exoskeletons System for Low-Cost Dexterous Teleoperation Yang, Shiqi Liu, Minghuan Qin, Yuzhe Ding, Runyu Li, Jialong Cheng, Xuxin Yang, Ruihan Yi, Sha Wang, Xiaolong Robotics Computer Vision and Pattern Recognition Machine Learning Learning from demonstrations has shown to be an effective approach to robotic manipulation, especially with the recently collected large-scale robot data with teleoperation systems. Building an efficient teleoperation system across diverse robot platforms has become more crucial than ever. However, there is a notable lack of cost-effective and user-friendly teleoperation systems for different end-effectors, e.g., anthropomorphic robot hands and grippers, that can operate across multiple platforms. To address this issue, we develop ACE, a cross-platform visual-exoskeleton system for low-cost dexterous teleoperation. Our system utilizes a hand-facing camera to capture 3D hand poses and an exoskeleton mounted on a portable base, enabling accurate real-time capture of both finger and wrist poses. Compared to previous systems, which often require hardware customization according to different robots, our single system can generalize to humanoid hands, arm-hands, arm-gripper, and quadruped-gripper systems with high-precision teleoperation. This enables imitation learning for complex manipulation tasks on diverse platforms. |
| title | ACE: A Cross-Platform Visual-Exoskeletons System for Low-Cost Dexterous Teleoperation |
| topic | Robotics Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2408.11805 |