Adaptive Reinforcement Learning for State Avoidance in Discrete Event Systems

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteur principal: Dony, Md Nur-A-Adam
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909617762598912
author Dony, Md Nur-A-Adam
author_facet Dony, Md Nur-A-Adam
contents Reinforcement learning (RL) has emerged as a potent paradigm for autonomous decision-making in complex environments. However, the integration of event-driven decision processes within RL remains a challenge. This paper presents a novel architecture that combines a Discrete Event Supervisory (DES) model with a standard RL framework to create a hybrid decision-making system. Our model leverages the DES's capabilities in managing event-based dynamics with the RL agent's adaptability to continuous states and actions, facilitating a more robust and flexible control strategy in systems characterized by both continuous and discrete events. The DES model operates alongside the RL agent, enhancing the policy's performance with event-based insights, while the environment's state transitions are governed by a mechanistic model. We demonstrate the efficacy of our approach through simulations that show improved performance metrics over traditional RL implementations. Our results suggest that this integrated approach holds promise for applications ranging from industrial automation to intelligent traffic systems, where discrete event handling is paramount.
format Preprint
id arxiv_https___arxiv_org_abs_2503_00192
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Adaptive Reinforcement Learning for State Avoidance in Discrete Event Systems
Dony, Md Nur-A-Adam
Systems and Control
68T05 % Learning and adaptive systems in AI
Reinforcement learning (RL) has emerged as a potent paradigm for autonomous decision-making in complex environments. However, the integration of event-driven decision processes within RL remains a challenge. This paper presents a novel architecture that combines a Discrete Event Supervisory (DES) model with a standard RL framework to create a hybrid decision-making system. Our model leverages the DES's capabilities in managing event-based dynamics with the RL agent's adaptability to continuous states and actions, facilitating a more robust and flexible control strategy in systems characterized by both continuous and discrete events. The DES model operates alongside the RL agent, enhancing the policy's performance with event-based insights, while the environment's state transitions are governed by a mechanistic model. We demonstrate the efficacy of our approach through simulations that show improved performance metrics over traditional RL implementations. Our results suggest that this integrated approach holds promise for applications ranging from industrial automation to intelligent traffic systems, where discrete event handling is paramount.
title Adaptive Reinforcement Learning for State Avoidance in Discrete Event Systems
topic Systems and Control
68T05 % Learning and adaptive systems in AI
url https://arxiv.org/abs/2503.00192