Learning Dexterous Manipulation with Quantized Hand State

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Feng, Ying, Fang, Hongjie, He, Yinong, Chen, Jingjing, Wang, Chenxi, He, Zihao, Liu, Ruonan, Lu, Cewu
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915863607640064
author Feng, Ying
Fang, Hongjie
He, Yinong
Chen, Jingjing
Wang, Chenxi
He, Zihao
Liu, Ruonan
Lu, Cewu
author_facet Feng, Ying
Fang, Hongjie
He, Yinong
Chen, Jingjing
Wang, Chenxi
He, Zihao
Liu, Ruonan
Lu, Cewu
contents Dexterous robotic hands enable robots to perform complex manipulations that require fine-grained control and adaptability. Achieving such manipulation is challenging because the high degrees of freedom tightly couple hand and arm motions, making learning and control difficult. Successful dexterous manipulation relies not only on precise hand motions, but also on accurate spatial positioning of the arm and coordinated arm-hand dynamics. However, most existing visuomotor policies represent arm and hand actions in a single combined space, which often causes high-dimensional hand actions to dominate the coupled action space and compromise arm control. To address this, we propose DQ-RISE, which quantizes hand states to simplify hand motion prediction while preserving essential patterns, and applies a continuous relaxation that allows arm actions to diffuse jointly with these compact hand states. This design enables the policy to learn arm-hand coordination from data while preventing hand actions from overwhelming the action space. Experiments show that DQ-RISE achieves more balanced and efficient learning, paving the way toward structured and generalizable dexterous manipulation. Project website: http://rise-policy.github.io/DQ-RISE/
format Preprint
id arxiv_https___arxiv_org_abs_2509_17450
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning Dexterous Manipulation with Quantized Hand State
Feng, Ying
Fang, Hongjie
He, Yinong
Chen, Jingjing
Wang, Chenxi
He, Zihao
Liu, Ruonan
Lu, Cewu
Robotics
Dexterous robotic hands enable robots to perform complex manipulations that require fine-grained control and adaptability. Achieving such manipulation is challenging because the high degrees of freedom tightly couple hand and arm motions, making learning and control difficult. Successful dexterous manipulation relies not only on precise hand motions, but also on accurate spatial positioning of the arm and coordinated arm-hand dynamics. However, most existing visuomotor policies represent arm and hand actions in a single combined space, which often causes high-dimensional hand actions to dominate the coupled action space and compromise arm control. To address this, we propose DQ-RISE, which quantizes hand states to simplify hand motion prediction while preserving essential patterns, and applies a continuous relaxation that allows arm actions to diffuse jointly with these compact hand states. This design enables the policy to learn arm-hand coordination from data while preventing hand actions from overwhelming the action space. Experiments show that DQ-RISE achieves more balanced and efficient learning, paving the way toward structured and generalizable dexterous manipulation. Project website: http://rise-policy.github.io/DQ-RISE/
title Learning Dexterous Manipulation with Quantized Hand State
topic Robotics
url https://arxiv.org/abs/2509.17450