RobustDexGrasp: Robust Dexterous Grasping of General Objects

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Hui, Wu, Zijian, Huang, Linyi, Christen, Sammy, Song, Jie
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916897422835712
author Zhang, Hui
Wu, Zijian
Huang, Linyi
Christen, Sammy
Song, Jie
author_facet Zhang, Hui
Wu, Zijian
Huang, Linyi
Christen, Sammy
Song, Jie
contents The ability to robustly grasp a variety of objects is essential for dexterous robots. In this paper, we present a framework for zero-shot dynamic dexterous grasping using single-view visual inputs, designed to be resilient to various disturbances. Our approach utilizes a hand-centric object shape representation based on dynamic distance vectors between finger joints and object surfaces. This representation captures the local shape around potential contact regions rather than focusing on detailed global object geometry, thereby enhancing generalization to shape variations and uncertainties. To address perception limitations, we integrate a privileged teacher policy with a mixed curriculum learning approach, allowing the student policy to effectively distill grasping capabilities and explore for adaptation to disturbances. Trained in simulation, our method achieves success rates of 97.0% across 247,786 simulated objects and 94.6% across 512 real objects, demonstrating remarkable generalization. Quantitative and qualitative results validate the robustness of our policy against various disturbances.
format Preprint
id arxiv_https___arxiv_org_abs_2504_05287
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RobustDexGrasp: Robust Dexterous Grasping of General Objects
Zhang, Hui
Wu, Zijian
Huang, Linyi
Christen, Sammy
Song, Jie
Robotics
The ability to robustly grasp a variety of objects is essential for dexterous robots. In this paper, we present a framework for zero-shot dynamic dexterous grasping using single-view visual inputs, designed to be resilient to various disturbances. Our approach utilizes a hand-centric object shape representation based on dynamic distance vectors between finger joints and object surfaces. This representation captures the local shape around potential contact regions rather than focusing on detailed global object geometry, thereby enhancing generalization to shape variations and uncertainties. To address perception limitations, we integrate a privileged teacher policy with a mixed curriculum learning approach, allowing the student policy to effectively distill grasping capabilities and explore for adaptation to disturbances. Trained in simulation, our method achieves success rates of 97.0% across 247,786 simulated objects and 94.6% across 512 real objects, demonstrating remarkable generalization. Quantitative and qualitative results validate the robustness of our policy against various disturbances.
title RobustDexGrasp: Robust Dexterous Grasping of General Objects
topic Robotics
url https://arxiv.org/abs/2504.05287