Saved in:
Bibliographic Details
Main Authors: Schäfer, Georg, Schirl, Max, Rehrl, Jakob, Huber, Stefan, Hirlaender, Simon
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.08567
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913350435209216
author Schäfer, Georg
Schirl, Max
Rehrl, Jakob
Huber, Stefan
Hirlaender, Simon
author_facet Schäfer, Georg
Schirl, Max
Rehrl, Jakob
Huber, Stefan
Hirlaender, Simon
contents This paper proposes a framework for training Reinforcement Learning agents using Python in conjunction with Simulink models. Leveraging Python's superior customization options and popular libraries like Stable Baselines3, we aim to bridge the gap between the established Simulink environment and the flexibility of Python for training bleeding edge agents. Our approach is demonstrated on the Quanser Aero 2, a versatile dual-rotor helicopter. We show that policies trained on Simulink models can be seamlessly transferred to the real system, enabling efficient development and deployment of Reinforcement Learning agents for control tasks. Through systematic integration steps, including C-code generation from Simulink, DLL compilation, and Python interface development, we establish a robust framework for training agents on Simulink models. Experimental results demonstrate the effectiveness of our approach, surpassing previous efforts and highlighting the potential of combining Simulink with Python for Reinforcement Learning research and applications.
format Preprint
id arxiv_https___arxiv_org_abs_2405_08567
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Python-Based Reinforcement Learning on Simulink Models
Schäfer, Georg
Schirl, Max
Rehrl, Jakob
Huber, Stefan
Hirlaender, Simon
Machine Learning
Systems and Control
This paper proposes a framework for training Reinforcement Learning agents using Python in conjunction with Simulink models. Leveraging Python's superior customization options and popular libraries like Stable Baselines3, we aim to bridge the gap between the established Simulink environment and the flexibility of Python for training bleeding edge agents. Our approach is demonstrated on the Quanser Aero 2, a versatile dual-rotor helicopter. We show that policies trained on Simulink models can be seamlessly transferred to the real system, enabling efficient development and deployment of Reinforcement Learning agents for control tasks. Through systematic integration steps, including C-code generation from Simulink, DLL compilation, and Python interface development, we establish a robust framework for training agents on Simulink models. Experimental results demonstrate the effectiveness of our approach, surpassing previous efforts and highlighting the potential of combining Simulink with Python for Reinforcement Learning research and applications.
title Python-Based Reinforcement Learning on Simulink Models
topic Machine Learning
Systems and Control
url https://arxiv.org/abs/2405.08567