Chemistry3D: Robotic Interaction Benchmark for Chemistry Experiments

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Shoujie, Huang, Yan, Guo, Changqing, Wu, Tong, Zhang, Jiawei, Zhang, Linrui, Ding, Wenbo
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913387888246784
author Li, Shoujie
Huang, Yan
Guo, Changqing
Wu, Tong
Zhang, Jiawei
Zhang, Linrui
Ding, Wenbo
author_facet Li, Shoujie
Huang, Yan
Guo, Changqing
Wu, Tong
Zhang, Jiawei
Zhang, Linrui
Ding, Wenbo
contents The advent of simulation engines has revolutionized learning and operational efficiency for robots, offering cost-effective and swift pipelines. However, the lack of a universal simulation platform tailored for chemical scenarios impedes progress in robotic manipulation and visualization of reaction processes. Addressing this void, we present Chemistry3D, an innovative toolkit that integrates extensive chemical and robotic knowledge. Chemistry3D not only enables robots to perform chemical experiments but also provides real-time visualization of temperature, color, and pH changes during reactions. Built on the NVIDIA Omniverse platform, Chemistry3D offers interfaces for robot operation, visual inspection, and liquid flow control, facilitating the simulation of special objects such as liquids and transparent entities. Leveraging this toolkit, we have devised RL tasks, object detection, and robot operation scenarios. Additionally, to discern disparities between the rendering engine and the real world, we conducted transparent object detection experiments using Sim2Real, validating the toolkit's exceptional simulation performance. The source code is available at https://github.com/huangyan28/Chemistry3D, and a related tutorial can be found at https://www.omni-chemistry.com.
format Preprint
id arxiv_https___arxiv_org_abs_2406_08160
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Chemistry3D: Robotic Interaction Benchmark for Chemistry Experiments
Li, Shoujie
Huang, Yan
Guo, Changqing
Wu, Tong
Zhang, Jiawei
Zhang, Linrui
Ding, Wenbo
Robotics
The advent of simulation engines has revolutionized learning and operational efficiency for robots, offering cost-effective and swift pipelines. However, the lack of a universal simulation platform tailored for chemical scenarios impedes progress in robotic manipulation and visualization of reaction processes. Addressing this void, we present Chemistry3D, an innovative toolkit that integrates extensive chemical and robotic knowledge. Chemistry3D not only enables robots to perform chemical experiments but also provides real-time visualization of temperature, color, and pH changes during reactions. Built on the NVIDIA Omniverse platform, Chemistry3D offers interfaces for robot operation, visual inspection, and liquid flow control, facilitating the simulation of special objects such as liquids and transparent entities. Leveraging this toolkit, we have devised RL tasks, object detection, and robot operation scenarios. Additionally, to discern disparities between the rendering engine and the real world, we conducted transparent object detection experiments using Sim2Real, validating the toolkit's exceptional simulation performance. The source code is available at https://github.com/huangyan28/Chemistry3D, and a related tutorial can be found at https://www.omni-chemistry.com.
title Chemistry3D: Robotic Interaction Benchmark for Chemistry Experiments
topic Robotics
url https://arxiv.org/abs/2406.08160