Deep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Khadivi, Maziyar, Charter, Todd, Yaghoubi, Marjan, Jalayer, Masoud, Ahang, Maryam, Shojaeinasab, Ardeshir, Najjaran, Homayoun
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917904388194304
author Khadivi, Maziyar
Charter, Todd
Yaghoubi, Marjan
Jalayer, Masoud
Ahang, Maryam
Shojaeinasab, Ardeshir
Najjaran, Homayoun
author_facet Khadivi, Maziyar
Charter, Todd
Yaghoubi, Marjan
Jalayer, Masoud
Ahang, Maryam
Shojaeinasab, Ardeshir
Najjaran, Homayoun
contents Machine scheduling aims to optimize job assignments to machines while adhering to manufacturing rules and job specifications. This optimization leads to reduced operational costs, improved customer demand fulfillment, and enhanced production efficiency. However, machine scheduling remains a challenging combinatorial problem due to its NP-hard nature. Deep Reinforcement Learning (DRL), a key component of artificial general intelligence, has shown promise in various domains like gaming and robotics. Researchers have explored applying DRL to machine scheduling problems since 1995. This paper offers a comprehensive review and comparison of DRL-based approaches, highlighting their methodology, applications, advantages, and limitations. It categorizes these approaches based on computational components: conventional neural networks, encoder-decoder architectures, graph neural networks, and metaheuristic algorithms. Our review concludes that DRL-based methods outperform exact solvers, heuristics, and tabular reinforcement learning algorithms in terms of computation speed and generating near-global optimal solutions. These DRL-based approaches have been successfully applied to static and dynamic scheduling across diverse machine environments and job characteristics. However, DRL-based schedulers face limitations in handling complex operational constraints, configurable multi-objective optimization, generalization, scalability, interpretability, and robustness. Addressing these challenges will be a crucial focus for future research in this field. This paper serves as a valuable resource for researchers to assess the current state of DRL-based machine scheduling and identify research gaps. It also aids experts and practitioners in selecting the appropriate DRL approach for production scheduling.
format Preprint
id arxiv_https___arxiv_org_abs_2310_03195
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Deep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions
Khadivi, Maziyar
Charter, Todd
Yaghoubi, Marjan
Jalayer, Masoud
Ahang, Maryam
Shojaeinasab, Ardeshir
Najjaran, Homayoun
Machine Learning
Artificial Intelligence
Neural and Evolutionary Computing
Machine scheduling aims to optimize job assignments to machines while adhering to manufacturing rules and job specifications. This optimization leads to reduced operational costs, improved customer demand fulfillment, and enhanced production efficiency. However, machine scheduling remains a challenging combinatorial problem due to its NP-hard nature. Deep Reinforcement Learning (DRL), a key component of artificial general intelligence, has shown promise in various domains like gaming and robotics. Researchers have explored applying DRL to machine scheduling problems since 1995. This paper offers a comprehensive review and comparison of DRL-based approaches, highlighting their methodology, applications, advantages, and limitations. It categorizes these approaches based on computational components: conventional neural networks, encoder-decoder architectures, graph neural networks, and metaheuristic algorithms. Our review concludes that DRL-based methods outperform exact solvers, heuristics, and tabular reinforcement learning algorithms in terms of computation speed and generating near-global optimal solutions. These DRL-based approaches have been successfully applied to static and dynamic scheduling across diverse machine environments and job characteristics. However, DRL-based schedulers face limitations in handling complex operational constraints, configurable multi-objective optimization, generalization, scalability, interpretability, and robustness. Addressing these challenges will be a crucial focus for future research in this field. This paper serves as a valuable resource for researchers to assess the current state of DRL-based machine scheduling and identify research gaps. It also aids experts and practitioners in selecting the appropriate DRL approach for production scheduling.
title Deep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions
topic Machine Learning
Artificial Intelligence
Neural and Evolutionary Computing
url https://arxiv.org/abs/2310.03195