Grasp to Act: Dexterous Grasping for Tool Use in Dynamic Settings

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Gupta, Harsh, Mirzaee, Mohammad Amin, Yuan, Wenzhen
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918353090641920
author Gupta, Harsh
Mirzaee, Mohammad Amin
Yuan, Wenzhen
author_facet Gupta, Harsh
Mirzaee, Mohammad Amin
Yuan, Wenzhen
contents Achieving robust grasping with dexterous hands remains challenging, especially when manipulation involves dynamic forces such as impacts, torques, and continuous resistance--situations common in real-world tool use. Existing methods largely optimize grasps for static geometric stability and often fail once external forces arise during manipulation. We present Grasp-to-Act, a hybrid system that combines physics-based grasp optimization with reinforcement-learning-based grasp adaptation to maintain stable grasps throughout functional manipulation tasks. Our method synthesizes robust grasp configurations informed by human demonstrations and employs an adaptive controller that residually issues joint corrections to prevent in-hand slip while tracking the object trajectory. Grasp-to-Act enables robust zero-shot sim-to-real transfer across five dynamic tool-use tasks--hammering, sawing, cutting, stirring, and scooping--consistently outperforming baselines. Across simulation and real-world hardware trials with a 16-DoF dexterous hand, our method reduces translational and rotational in-hand slip and achieves the highest task completion rates, demonstrating stable functional grasps under dynamic, contact-rich conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2602_20466
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Grasp to Act: Dexterous Grasping for Tool Use in Dynamic Settings
Gupta, Harsh
Mirzaee, Mohammad Amin
Yuan, Wenzhen
Robotics
Achieving robust grasping with dexterous hands remains challenging, especially when manipulation involves dynamic forces such as impacts, torques, and continuous resistance--situations common in real-world tool use. Existing methods largely optimize grasps for static geometric stability and often fail once external forces arise during manipulation. We present Grasp-to-Act, a hybrid system that combines physics-based grasp optimization with reinforcement-learning-based grasp adaptation to maintain stable grasps throughout functional manipulation tasks. Our method synthesizes robust grasp configurations informed by human demonstrations and employs an adaptive controller that residually issues joint corrections to prevent in-hand slip while tracking the object trajectory. Grasp-to-Act enables robust zero-shot sim-to-real transfer across five dynamic tool-use tasks--hammering, sawing, cutting, stirring, and scooping--consistently outperforming baselines. Across simulation and real-world hardware trials with a 16-DoF dexterous hand, our method reduces translational and rotational in-hand slip and achieves the highest task completion rates, demonstrating stable functional grasps under dynamic, contact-rich conditions.
title Grasp to Act: Dexterous Grasping for Tool Use in Dynamic Settings
topic Robotics
url https://arxiv.org/abs/2602.20466