DexH2R: A Benchmark for Dynamic Dexterous Grasping in Human-to-Robot Handover

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Youzhuo, Ye, Jiayi, Xiao, Chuyang, Zhong, Yiming, Tao, Heng, Yu, Hang, Liu, Yumeng, Yu, Jingyi, Ma, Yuexin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918078943592448
author Wang, Youzhuo
Ye, Jiayi
Xiao, Chuyang
Zhong, Yiming
Tao, Heng
Yu, Hang
Liu, Yumeng
Yu, Jingyi
Ma, Yuexin
author_facet Wang, Youzhuo
Ye, Jiayi
Xiao, Chuyang
Zhong, Yiming
Tao, Heng
Yu, Hang
Liu, Yumeng
Yu, Jingyi
Ma, Yuexin
contents Handover between a human and a dexterous robotic hand is a fundamental yet challenging task in human-robot collaboration. It requires handling dynamic environments and a wide variety of objects and demands robust and adaptive grasping strategies. However, progress in developing effective dynamic dexterous grasping methods is limited by the absence of high-quality, real-world human-to-robot handover datasets. Existing datasets primarily focus on grasping static objects or rely on synthesized handover motions, which differ significantly from real-world robot motion patterns, creating a substantial gap in applicability. In this paper, we introduce DexH2R, a comprehensive real-world dataset for human-to-robot handovers, built on a dexterous robotic hand. Our dataset captures a diverse range of interactive objects, dynamic motion patterns, rich visual sensor data, and detailed annotations. Additionally, to ensure natural and human-like dexterous motions, we utilize teleoperation for data collection, enabling the robot's movements to align with human behaviors and habits, which is a crucial characteristic for intelligent humanoid robots. Furthermore, we propose an effective solution, DynamicGrasp, for human-to-robot handover and evaluate various state-of-the-art approaches, including auto-regressive models and diffusion policy methods, providing a thorough comparison and analysis. We believe our benchmark will drive advancements in human-to-robot handover research by offering a high-quality dataset, effective solutions, and comprehensive evaluation metrics.
format Preprint
id arxiv_https___arxiv_org_abs_2506_23152
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DexH2R: A Benchmark for Dynamic Dexterous Grasping in Human-to-Robot Handover
Wang, Youzhuo
Ye, Jiayi
Xiao, Chuyang
Zhong, Yiming
Tao, Heng
Yu, Hang
Liu, Yumeng
Yu, Jingyi
Ma, Yuexin
Robotics
Handover between a human and a dexterous robotic hand is a fundamental yet challenging task in human-robot collaboration. It requires handling dynamic environments and a wide variety of objects and demands robust and adaptive grasping strategies. However, progress in developing effective dynamic dexterous grasping methods is limited by the absence of high-quality, real-world human-to-robot handover datasets. Existing datasets primarily focus on grasping static objects or rely on synthesized handover motions, which differ significantly from real-world robot motion patterns, creating a substantial gap in applicability. In this paper, we introduce DexH2R, a comprehensive real-world dataset for human-to-robot handovers, built on a dexterous robotic hand. Our dataset captures a diverse range of interactive objects, dynamic motion patterns, rich visual sensor data, and detailed annotations. Additionally, to ensure natural and human-like dexterous motions, we utilize teleoperation for data collection, enabling the robot's movements to align with human behaviors and habits, which is a crucial characteristic for intelligent humanoid robots. Furthermore, we propose an effective solution, DynamicGrasp, for human-to-robot handover and evaluate various state-of-the-art approaches, including auto-regressive models and diffusion policy methods, providing a thorough comparison and analysis. We believe our benchmark will drive advancements in human-to-robot handover research by offering a high-quality dataset, effective solutions, and comprehensive evaluation metrics.
title DexH2R: A Benchmark for Dynamic Dexterous Grasping in Human-to-Robot Handover
topic Robotics
url https://arxiv.org/abs/2506.23152