RoboGene: Boosting VLA Pre-training via Diversity-Driven Agentic Framework for Real-World Task Generation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhang, Yixue, Wu, Kun, Gao, Zhi, Zhao, Zhen, Ren, Pei, Xu, Zhiyuan, Liao, Fei, Wang, Xinhua, Fan, Shichao, Wu, Di, Feng, Qiuxuan, Li, Meng, Che, Zhengping, Liu, Chang, Tang, Jian
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917280894418944
author Zhang, Yixue
Wu, Kun
Gao, Zhi
Zhao, Zhen
Ren, Pei
Xu, Zhiyuan
Liao, Fei
Wang, Xinhua
Fan, Shichao
Wu, Di
Feng, Qiuxuan
Li, Meng
Che, Zhengping
Liu, Chang
Tang, Jian
author_facet Zhang, Yixue
Wu, Kun
Gao, Zhi
Zhao, Zhen
Ren, Pei
Xu, Zhiyuan
Liao, Fei
Wang, Xinhua
Fan, Shichao
Wu, Di
Feng, Qiuxuan
Li, Meng
Che, Zhengping
Liu, Chang
Tang, Jian
contents The pursuit of general-purpose robotic manipulation is hindered by the scarcity of diverse, real-world interaction data. Unlike data collection from web in vision or language, robotic data collection is an active process incurring prohibitive physical costs. Consequently, automated task curation to maximize data value remains a critical yet under-explored challenge. Existing manual methods are unscalable and biased toward common tasks, while off-the-shelf foundation models often hallucinate physically infeasible instructions. To address this, we introduce RoboGene, an agentic framework designed to automate the generation of diverse, physically plausible manipulation tasks across single-arm, dual-arm, and mobile robots. RoboGene integrates three core components: diversity-driven sampling for broad task coverage, self-reflection mechanisms to enforce physical constraints, and human-in-the-loop refinement for continuous improvement. We conduct extensive quantitative analysis and large-scale real-world experiments, collecting datasets of 18k trajectories and introducing novel metrics to assess task quality, feasibility, and diversity. Results demonstrate that RoboGene significantly outperforms state-of-the-art foundation models (e.g., GPT-4o, Gemini 2.5 Pro). Furthermore, real-world experiments show that VLA models pre-trained with RoboGene achieve higher success rates and superior generalization, underscoring the importance of high-quality task generation. Our project is available at https://robogene-boost-vla.github.io.
format Preprint
id arxiv_https___arxiv_org_abs_2602_16444
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle RoboGene: Boosting VLA Pre-training via Diversity-Driven Agentic Framework for Real-World Task Generation
Zhang, Yixue
Wu, Kun
Gao, Zhi
Zhao, Zhen
Ren, Pei
Xu, Zhiyuan
Liao, Fei
Wang, Xinhua
Fan, Shichao
Wu, Di
Feng, Qiuxuan
Li, Meng
Che, Zhengping
Liu, Chang
Tang, Jian
Robotics
Artificial Intelligence
Machine Learning
The pursuit of general-purpose robotic manipulation is hindered by the scarcity of diverse, real-world interaction data. Unlike data collection from web in vision or language, robotic data collection is an active process incurring prohibitive physical costs. Consequently, automated task curation to maximize data value remains a critical yet under-explored challenge. Existing manual methods are unscalable and biased toward common tasks, while off-the-shelf foundation models often hallucinate physically infeasible instructions. To address this, we introduce RoboGene, an agentic framework designed to automate the generation of diverse, physically plausible manipulation tasks across single-arm, dual-arm, and mobile robots. RoboGene integrates three core components: diversity-driven sampling for broad task coverage, self-reflection mechanisms to enforce physical constraints, and human-in-the-loop refinement for continuous improvement. We conduct extensive quantitative analysis and large-scale real-world experiments, collecting datasets of 18k trajectories and introducing novel metrics to assess task quality, feasibility, and diversity. Results demonstrate that RoboGene significantly outperforms state-of-the-art foundation models (e.g., GPT-4o, Gemini 2.5 Pro). Furthermore, real-world experiments show that VLA models pre-trained with RoboGene achieve higher success rates and superior generalization, underscoring the importance of high-quality task generation. Our project is available at https://robogene-boost-vla.github.io.
title RoboGene: Boosting VLA Pre-training via Diversity-Driven Agentic Framework for Real-World Task Generation
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2602.16444