LabUtopia: High-Fidelity Simulation and Hierarchical Benchmark for Scientific Embodied Agents

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Li, Rui, Hu, Zixuan, Qu, Wenxi, Zhang, Jinouwen, Yin, Zhenfei, Zhang, Sha, Huang, Xuantuo, Wang, Hanqing, Wang, Tai, Pang, Jiangmiao, Ouyang, Wanli, Bai, Lei, Zuo, Wangmeng, Duan, Ling-Yu, Zhou, Dongzhan, Tang, Shixiang
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912752734306304
author Li, Rui
Hu, Zixuan
Qu, Wenxi
Zhang, Jinouwen
Yin, Zhenfei
Zhang, Sha
Huang, Xuantuo
Wang, Hanqing
Wang, Tai
Pang, Jiangmiao
Ouyang, Wanli
Bai, Lei
Zuo, Wangmeng
Duan, Ling-Yu
Zhou, Dongzhan
Tang, Shixiang
author_facet Li, Rui
Hu, Zixuan
Qu, Wenxi
Zhang, Jinouwen
Yin, Zhenfei
Zhang, Sha
Huang, Xuantuo
Wang, Hanqing
Wang, Tai
Pang, Jiangmiao
Ouyang, Wanli
Bai, Lei
Zuo, Wangmeng
Duan, Ling-Yu
Zhou, Dongzhan
Tang, Shixiang
contents Scientific embodied agents play a crucial role in modern laboratories by automating complex experimental workflows. Compared to typical household environments, laboratory settings impose significantly higher demands on perception of physical-chemical transformations and long-horizon planning, making them an ideal testbed for advancing embodied intelligence. However, its development has been long hampered by the lack of suitable simulator and benchmarks. In this paper, we address this gap by introducing LabUtopia, a comprehensive simulation and benchmarking suite designed to facilitate the development of generalizable, reasoning-capable embodied agents in laboratory settings. Specifically, it integrates i) LabSim, a high-fidelity simulator supporting multi-physics and chemically meaningful interactions; ii) LabScene, a scalable procedural generator for diverse scientific scenes; and iii) LabBench, a hierarchical benchmark spanning five levels of complexity from atomic actions to long-horizon mobile manipulation. LabUtopia supports 30 distinct tasks and includes more than 200 scene and instrument assets, enabling large-scale training and principled evaluation in high-complexity environments. We demonstrate that LabUtopia offers a powerful platform for advancing the integration of perception, planning, and control in scientific-purpose agents and provides a rigorous testbed for exploring the practical capabilities and generalization limits of embodied intelligence in future research.
format Preprint
id arxiv_https___arxiv_org_abs_2505_22634
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LabUtopia: High-Fidelity Simulation and Hierarchical Benchmark for Scientific Embodied Agents
Li, Rui
Hu, Zixuan
Qu, Wenxi
Zhang, Jinouwen
Yin, Zhenfei
Zhang, Sha
Huang, Xuantuo
Wang, Hanqing
Wang, Tai
Pang, Jiangmiao
Ouyang, Wanli
Bai, Lei
Zuo, Wangmeng
Duan, Ling-Yu
Zhou, Dongzhan
Tang, Shixiang
Robotics
Software Engineering
Scientific embodied agents play a crucial role in modern laboratories by automating complex experimental workflows. Compared to typical household environments, laboratory settings impose significantly higher demands on perception of physical-chemical transformations and long-horizon planning, making them an ideal testbed for advancing embodied intelligence. However, its development has been long hampered by the lack of suitable simulator and benchmarks. In this paper, we address this gap by introducing LabUtopia, a comprehensive simulation and benchmarking suite designed to facilitate the development of generalizable, reasoning-capable embodied agents in laboratory settings. Specifically, it integrates i) LabSim, a high-fidelity simulator supporting multi-physics and chemically meaningful interactions; ii) LabScene, a scalable procedural generator for diverse scientific scenes; and iii) LabBench, a hierarchical benchmark spanning five levels of complexity from atomic actions to long-horizon mobile manipulation. LabUtopia supports 30 distinct tasks and includes more than 200 scene and instrument assets, enabling large-scale training and principled evaluation in high-complexity environments. We demonstrate that LabUtopia offers a powerful platform for advancing the integration of perception, planning, and control in scientific-purpose agents and provides a rigorous testbed for exploring the practical capabilities and generalization limits of embodied intelligence in future research.
title LabUtopia: High-Fidelity Simulation and Hierarchical Benchmark for Scientific Embodied Agents
topic Robotics
Software Engineering
url https://arxiv.org/abs/2505.22634