Open-Source Reinforcement Learning Environments Implemented in MuJoCo with Franka Manipulator
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866929439276793856 |
|---|---|
| author | Xu, Zichun Li, Yuntao Yang, Xiaohang Zhao, Zhiyuan Zhuang, Lei Zhao, Jingdong |
| author_facet | Xu, Zichun Li, Yuntao Yang, Xiaohang Zhao, Zhiyuan Zhuang, Lei Zhao, Jingdong |
| contents | This paper presents three open-source reinforcement learning environments developed on the MuJoCo physics engine with the Franka Emika Panda arm in MuJoCo Menagerie. Three representative tasks, push, slide, and pick-and-place, are implemented through the Gymnasium Robotics API, which inherits from the core of Gymnasium. Both the sparse binary and dense rewards are supported, and the observation space contains the keys of desired and achieved goals to follow the Multi-Goal Reinforcement Learning framework. Three different off-policy algorithms are used to validate the simulation attributes to ensure the fidelity of all tasks, and benchmark results are also given. Each environment and task are defined in a clean way, and the main parameters for modifying the environment are preserved to reflect the main difference. The repository, including all environments, is available at https://github.com/zichunxx/panda_mujoco_gym. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_13788 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Open-Source Reinforcement Learning Environments Implemented in MuJoCo with Franka Manipulator Xu, Zichun Li, Yuntao Yang, Xiaohang Zhao, Zhiyuan Zhuang, Lei Zhao, Jingdong Robotics This paper presents three open-source reinforcement learning environments developed on the MuJoCo physics engine with the Franka Emika Panda arm in MuJoCo Menagerie. Three representative tasks, push, slide, and pick-and-place, are implemented through the Gymnasium Robotics API, which inherits from the core of Gymnasium. Both the sparse binary and dense rewards are supported, and the observation space contains the keys of desired and achieved goals to follow the Multi-Goal Reinforcement Learning framework. Three different off-policy algorithms are used to validate the simulation attributes to ensure the fidelity of all tasks, and benchmark results are also given. Each environment and task are defined in a clean way, and the main parameters for modifying the environment are preserved to reflect the main difference. The repository, including all environments, is available at https://github.com/zichunxx/panda_mujoco_gym. |
| title | Open-Source Reinforcement Learning Environments Implemented in MuJoCo with Franka Manipulator |
| topic | Robotics |
| url | https://arxiv.org/abs/2312.13788 |