DextrAH-G: Pixels-to-Action Dexterous Arm-Hand Grasping with Geometric Fabrics
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909349085970432 |
|---|---|
| author | Lum, Tyler Ga Wei Matak, Martin Makoviychuk, Viktor Handa, Ankur Allshire, Arthur Hermans, Tucker Ratliff, Nathan D. Van Wyk, Karl |
| author_facet | Lum, Tyler Ga Wei Matak, Martin Makoviychuk, Viktor Handa, Ankur Allshire, Arthur Hermans, Tucker Ratliff, Nathan D. Van Wyk, Karl |
| contents | A pivotal challenge in robotics is achieving fast, safe, and robust dexterous grasping across a diverse range of objects, an important goal within industrial applications. However, existing methods often have very limited speed, dexterity, and generality, along with limited or no hardware safety guarantees. In this work, we introduce DextrAH-G, a depth-based dexterous grasping policy trained entirely in simulation that combines reinforcement learning, geometric fabrics, and teacher-student distillation. We address key challenges in joint arm-hand policy learning, such as high-dimensional observation and action spaces, the sim2real gap, collision avoidance, and hardware constraints. DextrAH-G enables a 23 motor arm-hand robot to safely and continuously grasp and transport a large variety of objects at high speed using multi-modal inputs including depth images, allowing generalization across object geometry. Videos at https://sites.google.com/view/dextrah-g. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_02274 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DextrAH-G: Pixels-to-Action Dexterous Arm-Hand Grasping with Geometric Fabrics Lum, Tyler Ga Wei Matak, Martin Makoviychuk, Viktor Handa, Ankur Allshire, Arthur Hermans, Tucker Ratliff, Nathan D. Van Wyk, Karl Robotics A pivotal challenge in robotics is achieving fast, safe, and robust dexterous grasping across a diverse range of objects, an important goal within industrial applications. However, existing methods often have very limited speed, dexterity, and generality, along with limited or no hardware safety guarantees. In this work, we introduce DextrAH-G, a depth-based dexterous grasping policy trained entirely in simulation that combines reinforcement learning, geometric fabrics, and teacher-student distillation. We address key challenges in joint arm-hand policy learning, such as high-dimensional observation and action spaces, the sim2real gap, collision avoidance, and hardware constraints. DextrAH-G enables a 23 motor arm-hand robot to safely and continuously grasp and transport a large variety of objects at high speed using multi-modal inputs including depth images, allowing generalization across object geometry. Videos at https://sites.google.com/view/dextrah-g. |
| title | DextrAH-G: Pixels-to-Action Dexterous Arm-Hand Grasping with Geometric Fabrics |
| topic | Robotics |
| url | https://arxiv.org/abs/2407.02274 |