RoboCAS: A Benchmark for Robotic Manipulation in Complex Object Arrangement Scenarios

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zheng, Liming, Yan, Feng, Liu, Fanfan, Feng, Chengjian, Kang, Zhuoliang, Ma, Lin
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917975336943616
author Zheng, Liming
Yan, Feng
Liu, Fanfan
Feng, Chengjian
Kang, Zhuoliang
Ma, Lin
author_facet Zheng, Liming
Yan, Feng
Liu, Fanfan
Feng, Chengjian
Kang, Zhuoliang
Ma, Lin
contents Foundation models hold significant potential for enabling robots to perform long-horizon general manipulation tasks. However, the simplicity of tasks and the uniformity of environments in existing benchmarks restrict their effective deployment in complex scenarios. To address this limitation, this paper introduces the \textit{RoboCAS} benchmark, the first benchmark specifically designed for complex object arrangement scenarios in robotic manipulation. This benchmark employs flexible and concise scripted policies to efficiently collect a diverse array of demonstrations, showcasing scattered, orderly, and stacked object arrangements within a highly realistic physical simulation environment. It includes complex processes such as target retrieval, obstacle clearance, and robot manipulation, testing agents' abilities to perform long-horizon planning for spatial reasoning and predicting chain reactions under ambiguous instructions. Extensive experiments on multiple baseline models reveal their limitations in managing complex object arrangement scenarios, underscoring the urgent need for intelligent agents capable of performing long-horizon operations in practical deployments and providing valuable insights for future research directions. Project website: \url{https://github.com/notFoundThisPerson/RoboCAS-v0}.
format Preprint
id arxiv_https___arxiv_org_abs_2407_06951
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle RoboCAS: A Benchmark for Robotic Manipulation in Complex Object Arrangement Scenarios
Zheng, Liming
Yan, Feng
Liu, Fanfan
Feng, Chengjian
Kang, Zhuoliang
Ma, Lin
Robotics
Machine Learning
Foundation models hold significant potential for enabling robots to perform long-horizon general manipulation tasks. However, the simplicity of tasks and the uniformity of environments in existing benchmarks restrict their effective deployment in complex scenarios. To address this limitation, this paper introduces the \textit{RoboCAS} benchmark, the first benchmark specifically designed for complex object arrangement scenarios in robotic manipulation. This benchmark employs flexible and concise scripted policies to efficiently collect a diverse array of demonstrations, showcasing scattered, orderly, and stacked object arrangements within a highly realistic physical simulation environment. It includes complex processes such as target retrieval, obstacle clearance, and robot manipulation, testing agents' abilities to perform long-horizon planning for spatial reasoning and predicting chain reactions under ambiguous instructions. Extensive experiments on multiple baseline models reveal their limitations in managing complex object arrangement scenarios, underscoring the urgent need for intelligent agents capable of performing long-horizon operations in practical deployments and providing valuable insights for future research directions. Project website: \url{https://github.com/notFoundThisPerson/RoboCAS-v0}.
title RoboCAS: A Benchmark for Robotic Manipulation in Complex Object Arrangement Scenarios
topic Robotics
Machine Learning
url https://arxiv.org/abs/2407.06951