Improving Mixed-Criticality Scheduling with Reinforcement Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: El-Mahdy, Muhammad, Sakr, Nourhan, Carrasco, Rodrigo
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916678219071488
author El-Mahdy, Muhammad
Sakr, Nourhan
Carrasco, Rodrigo
author_facet El-Mahdy, Muhammad
Sakr, Nourhan
Carrasco, Rodrigo
contents This paper introduces a novel reinforcement learning (RL) approach to scheduling mixed-criticality (MC) systems on processors with varying speeds. Building upon the foundation laid by [1], we extend their work to address the non-preemptive scheduling problem, which is known to be NP-hard. By modeling this scheduling challenge as a Markov Decision Process (MDP), we develop an RL agent capable of generating near-optimal schedules for real-time MC systems. Our RL-based scheduler prioritizes high-critical tasks while maintaining overall system performance. Through extensive experiments, we demonstrate the scalability and effectiveness of our approach. The RL scheduler significantly improves task completion rates, achieving around 80% overall and 85% for high-criticality tasks across 100,000 instances of synthetic data and real data under varying system conditions. Moreover, under stable conditions without degradation, the scheduler achieves 94% overall task completion and 93% for high-criticality tasks. These results highlight the potential of RL-based schedulers in real-time and safety-critical applications, offering substantial improvements in handling complex and dynamic scheduling scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2504_03994
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Improving Mixed-Criticality Scheduling with Reinforcement Learning
El-Mahdy, Muhammad
Sakr, Nourhan
Carrasco, Rodrigo
Machine Learning
Artificial Intelligence
Multiagent Systems
Systems and Control
This paper introduces a novel reinforcement learning (RL) approach to scheduling mixed-criticality (MC) systems on processors with varying speeds. Building upon the foundation laid by [1], we extend their work to address the non-preemptive scheduling problem, which is known to be NP-hard. By modeling this scheduling challenge as a Markov Decision Process (MDP), we develop an RL agent capable of generating near-optimal schedules for real-time MC systems. Our RL-based scheduler prioritizes high-critical tasks while maintaining overall system performance. Through extensive experiments, we demonstrate the scalability and effectiveness of our approach. The RL scheduler significantly improves task completion rates, achieving around 80% overall and 85% for high-criticality tasks across 100,000 instances of synthetic data and real data under varying system conditions. Moreover, under stable conditions without degradation, the scheduler achieves 94% overall task completion and 93% for high-criticality tasks. These results highlight the potential of RL-based schedulers in real-time and safety-critical applications, offering substantial improvements in handling complex and dynamic scheduling scenarios.
title Improving Mixed-Criticality Scheduling with Reinforcement Learning
topic Machine Learning
Artificial Intelligence
Multiagent Systems
Systems and Control
url https://arxiv.org/abs/2504.03994