Saved in:
Bibliographic Details
Main Authors: Hu, Xiao, Yin, Qi, Shi, Yangming, Ye, Yang
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.23021
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918387523780608
author Hu, Xiao
Yin, Qi
Shi, Yangming
Ye, Yang
author_facet Hu, Xiao
Yin, Qi
Shi, Yangming
Ye, Yang
contents Data scarcity remains a fundamental challenge in robot learning. While human demonstrations benefit from abundant motion capture data and vast internet resources, robotic manipulation suffers from limited training examples. To bridge this gap between human and robot manipulation capabilities, we propose UniPrototype, a novel framework that enables effective knowledge transfer from human to robot domains via shared motion primitives. ur approach makes three key contributions: (1) We introduce a compositional prototype discovery mechanism with soft assignments, enabling multiple primitives to co-activate and thus capture blended and hierarchical skills; (2) We propose an adaptive prototype selection strategy that automatically adjusts the number of prototypes to match task complexity, ensuring scalable and efficient representation; (3) We demonstrate the effectiveness of our method through extensive experiments in both simulation environments and real-world robotic systems. Our results show that UniPrototype successfully transfers human manipulation knowledge to robots, significantly improving learning efficiency and task performance compared to existing approaches.The code and dataset will be released upon acceptance at an anonymous repository.
format Preprint
id arxiv_https___arxiv_org_abs_2509_23021
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle UniPrototype: Humn-Robot Skill Learning with Uniform Prototypes
Hu, Xiao
Yin, Qi
Shi, Yangming
Ye, Yang
Robotics
Computer Vision and Pattern Recognition
Data scarcity remains a fundamental challenge in robot learning. While human demonstrations benefit from abundant motion capture data and vast internet resources, robotic manipulation suffers from limited training examples. To bridge this gap between human and robot manipulation capabilities, we propose UniPrototype, a novel framework that enables effective knowledge transfer from human to robot domains via shared motion primitives. ur approach makes three key contributions: (1) We introduce a compositional prototype discovery mechanism with soft assignments, enabling multiple primitives to co-activate and thus capture blended and hierarchical skills; (2) We propose an adaptive prototype selection strategy that automatically adjusts the number of prototypes to match task complexity, ensuring scalable and efficient representation; (3) We demonstrate the effectiveness of our method through extensive experiments in both simulation environments and real-world robotic systems. Our results show that UniPrototype successfully transfers human manipulation knowledge to robots, significantly improving learning efficiency and task performance compared to existing approaches.The code and dataset will be released upon acceptance at an anonymous repository.
title UniPrototype: Humn-Robot Skill Learning with Uniform Prototypes
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.23021