RobocupGym: A challenging continuous control benchmark in Robocup

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Beukman, Michael, Ingram, Branden, Tasse, Geraud Nangue, Rosman, Benjamin, Ranchod, Pravesh
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909262844788736
author Beukman, Michael
Ingram, Branden
Tasse, Geraud Nangue
Rosman, Benjamin
Ranchod, Pravesh
author_facet Beukman, Michael
Ingram, Branden
Tasse, Geraud Nangue
Rosman, Benjamin
Ranchod, Pravesh
contents Reinforcement learning (RL) has progressed substantially over the past decade, with much of this progress being driven by benchmarks. Many benchmarks are focused on video or board games, and a large number of robotics benchmarks lack diversity and real-world applicability. In this paper, we aim to simplify the process of applying reinforcement learning in the 3D simulation league of Robocup, a robotic football competition. To this end, we introduce a Robocup-based RL environment based on the open source rcssserver3d soccer server, simple pre-defined tasks, and integration with a popular RL library, Stable Baselines 3. Our environment enables the creation of high-dimensional continuous control tasks within a robotics football simulation. In each task, an RL agent controls a simulated Nao robot, and can interact with the ball or other agents. We open-source our environment and training code at https://github.com/Michael-Beukman/RobocupGym.
format Preprint
id arxiv_https___arxiv_org_abs_2407_14516
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle RobocupGym: A challenging continuous control benchmark in Robocup
Beukman, Michael
Ingram, Branden
Tasse, Geraud Nangue
Rosman, Benjamin
Ranchod, Pravesh
Robotics
Machine Learning
Reinforcement learning (RL) has progressed substantially over the past decade, with much of this progress being driven by benchmarks. Many benchmarks are focused on video or board games, and a large number of robotics benchmarks lack diversity and real-world applicability. In this paper, we aim to simplify the process of applying reinforcement learning in the 3D simulation league of Robocup, a robotic football competition. To this end, we introduce a Robocup-based RL environment based on the open source rcssserver3d soccer server, simple pre-defined tasks, and integration with a popular RL library, Stable Baselines 3. Our environment enables the creation of high-dimensional continuous control tasks within a robotics football simulation. In each task, an RL agent controls a simulated Nao robot, and can interact with the ball or other agents. We open-source our environment and training code at https://github.com/Michael-Beukman/RobocupGym.
title RobocupGym: A challenging continuous control benchmark in Robocup
topic Robotics
Machine Learning
url https://arxiv.org/abs/2407.14516