Is Diversity All You Need for Scalable Robotic Manipulation?

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shi, Modi, Chen, Li, Chen, Jin, Lu, Yuxiang, Liu, Chiming, Ren, Guanghui, Luo, Ping, Huang, Di, Yao, Maoqing, Li, Hongyang
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916832874594304
author Shi, Modi
Chen, Li
Chen, Jin
Lu, Yuxiang
Liu, Chiming
Ren, Guanghui
Luo, Ping
Huang, Di
Yao, Maoqing
Li, Hongyang
author_facet Shi, Modi
Chen, Li
Chen, Jin
Lu, Yuxiang
Liu, Chiming
Ren, Guanghui
Luo, Ping
Huang, Di
Yao, Maoqing
Li, Hongyang
contents Data scaling has driven remarkable success in foundation models for Natural Language Processing (NLP) and Computer Vision (CV), yet the principles of effective data scaling in robotic manipulation remain insufficiently understood. In this work, we investigate the nuanced role of data diversity in robot learning by examining three critical dimensions-task (what to do), embodiment (which robot to use), and expert (who demonstrates)-challenging the conventional intuition of "more diverse is better". Throughout extensive experiments on various robot platforms, we reveal that (1) task diversity proves more critical than per-task demonstration quantity, benefiting transfer from diverse pre-training tasks to novel downstream scenarios; (2) multi-embodiment pre-training data is optional for cross-embodiment transfer-models trained on high-quality single-embodiment data can efficiently transfer to different platforms, showing more desirable scaling property during fine-tuning than multi-embodiment pre-trained models; and (3) expert diversity, arising from individual operational preferences and stochastic variations in human demonstrations, can be confounding to policy learning, with velocity multimodality emerging as a key contributing factor. Based on this insight, we propose a distribution debiasing method to mitigate velocity ambiguity, the yielding GO-1-Pro achieves substantial performance gains of 15%, equivalent to using 2.5 times pre-training data. Collectively, these findings provide new perspectives and offer practical guidance on how to scale robotic manipulation datasets effectively.
format Preprint
id arxiv_https___arxiv_org_abs_2507_06219
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Is Diversity All You Need for Scalable Robotic Manipulation?
Shi, Modi
Chen, Li
Chen, Jin
Lu, Yuxiang
Liu, Chiming
Ren, Guanghui
Luo, Ping
Huang, Di
Yao, Maoqing
Li, Hongyang
Robotics
Artificial Intelligence
Machine Learning
Data scaling has driven remarkable success in foundation models for Natural Language Processing (NLP) and Computer Vision (CV), yet the principles of effective data scaling in robotic manipulation remain insufficiently understood. In this work, we investigate the nuanced role of data diversity in robot learning by examining three critical dimensions-task (what to do), embodiment (which robot to use), and expert (who demonstrates)-challenging the conventional intuition of "more diverse is better". Throughout extensive experiments on various robot platforms, we reveal that (1) task diversity proves more critical than per-task demonstration quantity, benefiting transfer from diverse pre-training tasks to novel downstream scenarios; (2) multi-embodiment pre-training data is optional for cross-embodiment transfer-models trained on high-quality single-embodiment data can efficiently transfer to different platforms, showing more desirable scaling property during fine-tuning than multi-embodiment pre-trained models; and (3) expert diversity, arising from individual operational preferences and stochastic variations in human demonstrations, can be confounding to policy learning, with velocity multimodality emerging as a key contributing factor. Based on this insight, we propose a distribution debiasing method to mitigate velocity ambiguity, the yielding GO-1-Pro achieves substantial performance gains of 15%, equivalent to using 2.5 times pre-training data. Collectively, these findings provide new perspectives and offer practical guidance on how to scale robotic manipulation datasets effectively.
title Is Diversity All You Need for Scalable Robotic Manipulation?
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2507.06219