RRLS : Robust Reinforcement Learning Suite

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zouitine, Adil, Bertoin, David, Clavier, Pierre, Geist, Matthieu, Rachelson, Emmanuel
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914833067147264
author Zouitine, Adil
Bertoin, David
Clavier, Pierre
Geist, Matthieu
Rachelson, Emmanuel
author_facet Zouitine, Adil
Bertoin, David
Clavier, Pierre
Geist, Matthieu
Rachelson, Emmanuel
contents Robust reinforcement learning is the problem of learning control policies that provide optimal worst-case performance against a span of adversarial environments. It is a crucial ingredient for deploying algorithms in real-world scenarios with prevalent environmental uncertainties and has been a long-standing object of attention in the community, without a standardized set of benchmarks. This contribution endeavors to fill this gap. We introduce the Robust Reinforcement Learning Suite (RRLS), a benchmark suite based on Mujoco environments. RRLS provides six continuous control tasks with two types of uncertainty sets for training and evaluation. Our benchmark aims to standardize robust reinforcement learning tasks, facilitating reproducible and comparable experiments, in particular those from recent state-of-the-art contributions, for which we demonstrate the use of RRLS. It is also designed to be easily expandable to new environments. The source code is available at \href{https://github.com/SuReLI/RRLS}{https://github.com/SuReLI/RRLS}.
format Preprint
id arxiv_https___arxiv_org_abs_2406_08406
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle RRLS : Robust Reinforcement Learning Suite
Zouitine, Adil
Bertoin, David
Clavier, Pierre
Geist, Matthieu
Rachelson, Emmanuel
Machine Learning
Robust reinforcement learning is the problem of learning control policies that provide optimal worst-case performance against a span of adversarial environments. It is a crucial ingredient for deploying algorithms in real-world scenarios with prevalent environmental uncertainties and has been a long-standing object of attention in the community, without a standardized set of benchmarks. This contribution endeavors to fill this gap. We introduce the Robust Reinforcement Learning Suite (RRLS), a benchmark suite based on Mujoco environments. RRLS provides six continuous control tasks with two types of uncertainty sets for training and evaluation. Our benchmark aims to standardize robust reinforcement learning tasks, facilitating reproducible and comparable experiments, in particular those from recent state-of-the-art contributions, for which we demonstrate the use of RRLS. It is also designed to be easily expandable to new environments. The source code is available at \href{https://github.com/SuReLI/RRLS}{https://github.com/SuReLI/RRLS}.
title RRLS : Robust Reinforcement Learning Suite
topic Machine Learning
url https://arxiv.org/abs/2406.08406