Python-Based Reinforcement Learning on Simulink Models

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Schäfer, Georg, Schirl, Max, Rehrl, Jakob, Huber, Stefan, Hirlaender, Simon
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913350435209216
author Schäfer, Georg
Schirl, Max
Rehrl, Jakob
Huber, Stefan
Hirlaender, Simon
author_facet Schäfer, Georg
Schirl, Max
Rehrl, Jakob
Huber, Stefan
Hirlaender, Simon
contents This paper proposes a framework for training Reinforcement Learning agents using Python in conjunction with Simulink models. Leveraging Python's superior customization options and popular libraries like Stable Baselines3, we aim to bridge the gap between the established Simulink environment and the flexibility of Python for training bleeding edge agents. Our approach is demonstrated on the Quanser Aero 2, a versatile dual-rotor helicopter. We show that policies trained on Simulink models can be seamlessly transferred to the real system, enabling efficient development and deployment of Reinforcement Learning agents for control tasks. Through systematic integration steps, including C-code generation from Simulink, DLL compilation, and Python interface development, we establish a robust framework for training agents on Simulink models. Experimental results demonstrate the effectiveness of our approach, surpassing previous efforts and highlighting the potential of combining Simulink with Python for Reinforcement Learning research and applications.
format Preprint
id arxiv_https___arxiv_org_abs_2405_08567
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Python-Based Reinforcement Learning on Simulink Models
Schäfer, Georg
Schirl, Max
Rehrl, Jakob
Huber, Stefan
Hirlaender, Simon
Machine Learning
Systems and Control
This paper proposes a framework for training Reinforcement Learning agents using Python in conjunction with Simulink models. Leveraging Python's superior customization options and popular libraries like Stable Baselines3, we aim to bridge the gap between the established Simulink environment and the flexibility of Python for training bleeding edge agents. Our approach is demonstrated on the Quanser Aero 2, a versatile dual-rotor helicopter. We show that policies trained on Simulink models can be seamlessly transferred to the real system, enabling efficient development and deployment of Reinforcement Learning agents for control tasks. Through systematic integration steps, including C-code generation from Simulink, DLL compilation, and Python interface development, we establish a robust framework for training agents on Simulink models. Experimental results demonstrate the effectiveness of our approach, surpassing previous efforts and highlighting the potential of combining Simulink with Python for Reinforcement Learning research and applications.
title Python-Based Reinforcement Learning on Simulink Models
topic Machine Learning
Systems and Control
url https://arxiv.org/abs/2405.08567