CleanQRL: Lightweight Single-file Implementations of Quantum Reinforcement Learning Algorithms

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kruse, Georg, Coelho, Rodrigo, Rosskopf, Andreas, Wille, Robert, Lorenz, Jeanette Miriam
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911049264922624
author Kruse, Georg
Coelho, Rodrigo
Rosskopf, Andreas
Wille, Robert
Lorenz, Jeanette Miriam
author_facet Kruse, Georg
Coelho, Rodrigo
Rosskopf, Andreas
Wille, Robert
Lorenz, Jeanette Miriam
contents At the interception between quantum computing and machine learning, Quantum Reinforcement Learning (QRL) has emerged as a promising research field. Due to its novelty, a standardized and comprehensive collection for QRL algorithms has not yet been established. Researchers rely on numerous software stacks for classical Reinforcement Learning (RL) as well as on various quantum computing frameworks for the implementation of the quantum subroutines of their QRL algorithms. Inspired by the CleanRL library for classical RL algorithms, we present CleanQRL, a library that offers single-script implementations of many QRL algorithms. Our library provides clear and easy to understand scripts that researchers can quickly adapt to their own needs. Alongside ray tune for distributed computing and streamlined hyperparameter tuning, CleanQRL uses weights&biases to log important metrics, which facilitates benchmarking against other classical and quantum implementations. The CleanQRL library enables researchers to easily transition from theoretical considerations to practical applications.
format Preprint
id arxiv_https___arxiv_org_abs_2507_07593
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CleanQRL: Lightweight Single-file Implementations of Quantum Reinforcement Learning Algorithms
Kruse, Georg
Coelho, Rodrigo
Rosskopf, Andreas
Wille, Robert
Lorenz, Jeanette Miriam
Quantum Physics
At the interception between quantum computing and machine learning, Quantum Reinforcement Learning (QRL) has emerged as a promising research field. Due to its novelty, a standardized and comprehensive collection for QRL algorithms has not yet been established. Researchers rely on numerous software stacks for classical Reinforcement Learning (RL) as well as on various quantum computing frameworks for the implementation of the quantum subroutines of their QRL algorithms. Inspired by the CleanRL library for classical RL algorithms, we present CleanQRL, a library that offers single-script implementations of many QRL algorithms. Our library provides clear and easy to understand scripts that researchers can quickly adapt to their own needs. Alongside ray tune for distributed computing and streamlined hyperparameter tuning, CleanQRL uses weights&biases to log important metrics, which facilitates benchmarking against other classical and quantum implementations. The CleanQRL library enables researchers to easily transition from theoretical considerations to practical applications.
title CleanQRL: Lightweight Single-file Implementations of Quantum Reinforcement Learning Algorithms
topic Quantum Physics
url https://arxiv.org/abs/2507.07593