Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916127160926208 |
|---|---|
| author | Mittal, Mayank Yu, Calvin Yu, Qinxi Liu, Jingzhou Rudin, Nikita Hoeller, David Yuan, Jia Lin Singh, Ritvik Guo, Yunrong Mazhar, Hammad Mandlekar, Ajay Babich, Buck State, Gavriel Hutter, Marco Garg, Animesh |
| author_facet | Mittal, Mayank Yu, Calvin Yu, Qinxi Liu, Jingzhou Rudin, Nikita Hoeller, David Yuan, Jia Lin Singh, Ritvik Guo, Yunrong Mazhar, Hammad Mandlekar, Ajay Babich, Buck State, Gavriel Hutter, Marco Garg, Animesh |
| contents | We present Orbit, a unified and modular framework for robot learning powered by NVIDIA Isaac Sim. It offers a modular design to easily and efficiently create robotic environments with photo-realistic scenes and high-fidelity rigid and deformable body simulation. With Orbit, we provide a suite of benchmark tasks of varying difficulty -- from single-stage cabinet opening and cloth folding to multi-stage tasks such as room reorganization. To support working with diverse observations and action spaces, we include fixed-arm and mobile manipulators with different physically-based sensors and motion generators. Orbit allows training reinforcement learning policies and collecting large demonstration datasets from hand-crafted or expert solutions in a matter of minutes by leveraging GPU-based parallelization. In summary, we offer an open-sourced framework that readily comes with 16 robotic platforms, 4 sensor modalities, 10 motion generators, more than 20 benchmark tasks, and wrappers to 4 learning libraries. With this framework, we aim to support various research areas, including representation learning, reinforcement learning, imitation learning, and task and motion planning. We hope it helps establish interdisciplinary collaborations in these communities, and its modularity makes it easily extensible for more tasks and applications in the future. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2301_04195 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments Mittal, Mayank Yu, Calvin Yu, Qinxi Liu, Jingzhou Rudin, Nikita Hoeller, David Yuan, Jia Lin Singh, Ritvik Guo, Yunrong Mazhar, Hammad Mandlekar, Ajay Babich, Buck State, Gavriel Hutter, Marco Garg, Animesh Robotics Artificial Intelligence We present Orbit, a unified and modular framework for robot learning powered by NVIDIA Isaac Sim. It offers a modular design to easily and efficiently create robotic environments with photo-realistic scenes and high-fidelity rigid and deformable body simulation. With Orbit, we provide a suite of benchmark tasks of varying difficulty -- from single-stage cabinet opening and cloth folding to multi-stage tasks such as room reorganization. To support working with diverse observations and action spaces, we include fixed-arm and mobile manipulators with different physically-based sensors and motion generators. Orbit allows training reinforcement learning policies and collecting large demonstration datasets from hand-crafted or expert solutions in a matter of minutes by leveraging GPU-based parallelization. In summary, we offer an open-sourced framework that readily comes with 16 robotic platforms, 4 sensor modalities, 10 motion generators, more than 20 benchmark tasks, and wrappers to 4 learning libraries. With this framework, we aim to support various research areas, including representation learning, reinforcement learning, imitation learning, and task and motion planning. We hope it helps establish interdisciplinary collaborations in these communities, and its modularity makes it easily extensible for more tasks and applications in the future. |
| title | Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2301.04195 |