ReLA: Representation Learning and Aggregation for Job Scheduling with Reinforcement Learning

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Kwan, Zhengyi, Zhang, Wei, Ng, Aik Beng, Wang, Zhengkui, See, Simon
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914239158943744
author Kwan, Zhengyi
Zhang, Wei
Ng, Aik Beng
Wang, Zhengkui
See, Simon
author_facet Kwan, Zhengyi
Zhang, Wei
Ng, Aik Beng
Wang, Zhengkui
See, Simon
contents Job scheduling is widely used in real-world manufacturing systems to assign ordered job operations to machines under various constraints. Existing solutions remain limited by long running time or insufficient schedule quality, especially when problem scale increases. In this paper, we propose ReLA, a reinforcement-learning (RL) scheduler built on structured representation learning and aggregation. ReLA first learns diverse representations from scheduling entities, including job operations and machines, using two intra-entity learning modules with self-attention and convolution and one inter-entity learning module with cross-attention. These modules are applied in a multi-scale architecture, and their outputs are aggregated to support RL decision-making. Across experiments on small, medium, and large job instances, ReLA achieves the best makespan in most tested settings over the latest solutions. On non-large instances, ReLA reduces the optimality gap of the SOTA baseline by 13.0%, while on large-scale instances it reduces the gap by 78.6%, with the average optimality gaps lowered to 7.3% and 2.1%, respectively. These results confirm that ReLA's learned representations and aggregation provide strong decision support for RL scheduling, and enable fast job completion and decision-making for real-world applications.
format Preprint
id arxiv_https___arxiv_org_abs_2601_03646
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ReLA: Representation Learning and Aggregation for Job Scheduling with Reinforcement Learning
Kwan, Zhengyi
Zhang, Wei
Ng, Aik Beng
Wang, Zhengkui
See, Simon
Machine Learning
Artificial Intelligence
Job scheduling is widely used in real-world manufacturing systems to assign ordered job operations to machines under various constraints. Existing solutions remain limited by long running time or insufficient schedule quality, especially when problem scale increases. In this paper, we propose ReLA, a reinforcement-learning (RL) scheduler built on structured representation learning and aggregation. ReLA first learns diverse representations from scheduling entities, including job operations and machines, using two intra-entity learning modules with self-attention and convolution and one inter-entity learning module with cross-attention. These modules are applied in a multi-scale architecture, and their outputs are aggregated to support RL decision-making. Across experiments on small, medium, and large job instances, ReLA achieves the best makespan in most tested settings over the latest solutions. On non-large instances, ReLA reduces the optimality gap of the SOTA baseline by 13.0%, while on large-scale instances it reduces the gap by 78.6%, with the average optimality gaps lowered to 7.3% and 2.1%, respectively. These results confirm that ReLA's learned representations and aggregation provide strong decision support for RL scheduling, and enable fast job completion and decision-making for real-world applications.
title ReLA: Representation Learning and Aggregation for Job Scheduling with Reinforcement Learning
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2601.03646