Bootstrapping Imitation Learning for Long-horizon Manipulation via Hierarchical Data Collection Space

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Jinrong, Chen, Kexun, Li, Zhuoling, Wu, Shengkai, Zhao, Yong, Ren, Liangliang, Luo, Wenqiu, Shang, Chaohui, Zhi, Meiyu, Gao, Linfeng, Sun, Mingshan, Cheng, Hui
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908376206671872
author Yang, Jinrong
Chen, Kexun
Li, Zhuoling
Wu, Shengkai
Zhao, Yong
Ren, Liangliang
Luo, Wenqiu
Shang, Chaohui
Zhi, Meiyu
Gao, Linfeng
Sun, Mingshan
Cheng, Hui
author_facet Yang, Jinrong
Chen, Kexun
Li, Zhuoling
Wu, Shengkai
Zhao, Yong
Ren, Liangliang
Luo, Wenqiu
Shang, Chaohui
Zhi, Meiyu
Gao, Linfeng
Sun, Mingshan
Cheng, Hui
contents Imitation learning (IL) with human demonstrations is a promising method for robotic manipulation tasks. While minimal demonstrations enable robotic action execution, achieving high success rates and generalization requires high cost, e.g., continuously adding data or incrementally conducting human-in-loop processes with complex hardware/software systems. In this paper, we rethink the state/action space of the data collection pipeline as well as the underlying factors responsible for the prediction of non-robust actions. To this end, we introduce a Hierarchical Data Collection Space (HD-Space) for robotic imitation learning, a simple data collection scheme, endowing the model to train with proactive and high-quality data. Specifically, We segment the fine manipulation task into multiple key atomic tasks from a high-level perspective and design atomic state/action spaces for human demonstrations, aiming to generate robust IL data. We conduct empirical evaluations across two simulated and five real-world long-horizon manipulation tasks and demonstrate that IL policy training with HD-Space-based data can achieve significantly enhanced policy performance. HD-Space allows the use of a small amount of demonstration data to train a more powerful policy, particularly for long-horizon manipulation tasks. We aim for HD-Space to offer insights into optimizing data quality and guiding data scaling. project page: https://hd-space-robotics.github.io.
format Preprint
id arxiv_https___arxiv_org_abs_2505_17389
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bootstrapping Imitation Learning for Long-horizon Manipulation via Hierarchical Data Collection Space
Yang, Jinrong
Chen, Kexun
Li, Zhuoling
Wu, Shengkai
Zhao, Yong
Ren, Liangliang
Luo, Wenqiu
Shang, Chaohui
Zhi, Meiyu
Gao, Linfeng
Sun, Mingshan
Cheng, Hui
Robotics
Artificial Intelligence
Imitation learning (IL) with human demonstrations is a promising method for robotic manipulation tasks. While minimal demonstrations enable robotic action execution, achieving high success rates and generalization requires high cost, e.g., continuously adding data or incrementally conducting human-in-loop processes with complex hardware/software systems. In this paper, we rethink the state/action space of the data collection pipeline as well as the underlying factors responsible for the prediction of non-robust actions. To this end, we introduce a Hierarchical Data Collection Space (HD-Space) for robotic imitation learning, a simple data collection scheme, endowing the model to train with proactive and high-quality data. Specifically, We segment the fine manipulation task into multiple key atomic tasks from a high-level perspective and design atomic state/action spaces for human demonstrations, aiming to generate robust IL data. We conduct empirical evaluations across two simulated and five real-world long-horizon manipulation tasks and demonstrate that IL policy training with HD-Space-based data can achieve significantly enhanced policy performance. HD-Space allows the use of a small amount of demonstration data to train a more powerful policy, particularly for long-horizon manipulation tasks. We aim for HD-Space to offer insights into optimizing data quality and guiding data scaling. project page: https://hd-space-robotics.github.io.
title Bootstrapping Imitation Learning for Long-horizon Manipulation via Hierarchical Data Collection Space
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2505.17389