Object-Focus Actor for Data-efficient Robot Generalization Dexterous Manipulation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913850010370048 |
|---|---|
| author | Li, Yihang Zhang, Tianle Wei, Xuelong Li, Jiayi Zhao, Lin Huang, Dongchi Fang, Zhirui Zheng, Minhua Dai, Wenjun He, Xiaodong |
| author_facet | Li, Yihang Zhang, Tianle Wei, Xuelong Li, Jiayi Zhao, Lin Huang, Dongchi Fang, Zhirui Zheng, Minhua Dai, Wenjun He, Xiaodong |
| contents | Robot manipulation learning from human demonstrations offers a rapid means to acquire skills but often lacks generalization across diverse scenes and object placements. This limitation hinders real-world applications, particularly in complex tasks requiring dexterous manipulation. Vision-Language-Action (VLA) paradigm leverages large-scale data to enhance generalization. However, due to data scarcity, VLA's performance remains limited. In this work, we introduce Object-Focus Actor (OFA), a novel, data-efficient approach for generalized dexterous manipulation. OFA exploits the consistent end trajectories observed in dexterous manipulation tasks, allowing for efficient policy training. Our method employs a hierarchical pipeline: object perception and pose estimation, pre-manipulation pose arrival and OFA policy execution. This process ensures that the manipulation is focused and efficient, even in varied backgrounds and positional layout. Comprehensive real-world experiments across seven tasks demonstrate that OFA significantly outperforms baseline methods in both positional and background generalization tests. Notably, OFA achieves robust performance with only 10 demonstrations, highlighting its data efficiency. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_15098 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Object-Focus Actor for Data-efficient Robot Generalization Dexterous Manipulation Li, Yihang Zhang, Tianle Wei, Xuelong Li, Jiayi Zhao, Lin Huang, Dongchi Fang, Zhirui Zheng, Minhua Dai, Wenjun He, Xiaodong Robotics Artificial Intelligence Robot manipulation learning from human demonstrations offers a rapid means to acquire skills but often lacks generalization across diverse scenes and object placements. This limitation hinders real-world applications, particularly in complex tasks requiring dexterous manipulation. Vision-Language-Action (VLA) paradigm leverages large-scale data to enhance generalization. However, due to data scarcity, VLA's performance remains limited. In this work, we introduce Object-Focus Actor (OFA), a novel, data-efficient approach for generalized dexterous manipulation. OFA exploits the consistent end trajectories observed in dexterous manipulation tasks, allowing for efficient policy training. Our method employs a hierarchical pipeline: object perception and pose estimation, pre-manipulation pose arrival and OFA policy execution. This process ensures that the manipulation is focused and efficient, even in varied backgrounds and positional layout. Comprehensive real-world experiments across seven tasks demonstrate that OFA significantly outperforms baseline methods in both positional and background generalization tests. Notably, OFA achieves robust performance with only 10 demonstrations, highlighting its data efficiency. |
| title | Object-Focus Actor for Data-efficient Robot Generalization Dexterous Manipulation |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2505.15098 |