Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Exploration

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Xu, Sirui, Chao, Yu-Wei, Bian, Liuyu, Mousavian, Arsalan, Wang, Yu-Xiong, Gui, Liang-Yan, Yang, Wei
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912583656669184
author Xu, Sirui
Chao, Yu-Wei
Bian, Liuyu
Mousavian, Arsalan
Wang, Yu-Xiong
Gui, Liang-Yan
Yang, Wei
author_facet Xu, Sirui
Chao, Yu-Wei
Bian, Liuyu
Mousavian, Arsalan
Wang, Yu-Xiong
Gui, Liang-Yan
Yang, Wei
contents Hand-object motion-capture (MoCap) repositories offer large-scale, contact-rich demonstrations and hold promise for scaling dexterous robotic manipulation. Yet demonstration inaccuracies and embodiment gaps between human and robot hands limit the straightforward use of these data. Existing methods adopt a three-stage workflow, including retargeting, tracking, and residual correction, which often leaves demonstrations underused and compound errors across stages. We introduce Dexplore, a unified single-loop optimization that jointly performs retargeting and tracking to learn robot control policies directly from MoCap at scale. Rather than treating demonstrations as ground truth, we use them as soft guidance. From raw trajectories, we derive adaptive spatial scopes, and train with reinforcement learning to keep the policy in-scope while minimizing control effort and accomplishing the task. This unified formulation preserves demonstration intent, enables robot-specific strategies to emerge, improves robustness to noise, and scales to large demonstration corpora. We distill the scaled tracking policy into a vision-based, skill-conditioned generative controller that encodes diverse manipulation skills in a rich latent representation, supporting generalization across objects and real-world deployment. Taken together, these contributions position Dexplore as a principled bridge that transforms imperfect demonstrations into effective training signals for dexterous manipulation.
format Preprint
id arxiv_https___arxiv_org_abs_2509_09671
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Exploration
Xu, Sirui
Chao, Yu-Wei
Bian, Liuyu
Mousavian, Arsalan
Wang, Yu-Xiong
Gui, Liang-Yan
Yang, Wei
Robotics
Computer Vision and Pattern Recognition
Hand-object motion-capture (MoCap) repositories offer large-scale, contact-rich demonstrations and hold promise for scaling dexterous robotic manipulation. Yet demonstration inaccuracies and embodiment gaps between human and robot hands limit the straightforward use of these data. Existing methods adopt a three-stage workflow, including retargeting, tracking, and residual correction, which often leaves demonstrations underused and compound errors across stages. We introduce Dexplore, a unified single-loop optimization that jointly performs retargeting and tracking to learn robot control policies directly from MoCap at scale. Rather than treating demonstrations as ground truth, we use them as soft guidance. From raw trajectories, we derive adaptive spatial scopes, and train with reinforcement learning to keep the policy in-scope while minimizing control effort and accomplishing the task. This unified formulation preserves demonstration intent, enables robot-specific strategies to emerge, improves robustness to noise, and scales to large demonstration corpora. We distill the scaled tracking policy into a vision-based, skill-conditioned generative controller that encodes diverse manipulation skills in a rich latent representation, supporting generalization across objects and real-world deployment. Taken together, these contributions position Dexplore as a principled bridge that transforms imperfect demonstrations into effective training signals for dexterous manipulation.
title Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Exploration
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.09671