Comparing Deep Reinforcement Learning Algorithms in Two-Echelon Supply Chains

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Stranieri, Francesco, Stella, Fabio
Format: Preprint
Veröffentlicht: 2022
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909448106147840
author Stranieri, Francesco
Stella, Fabio
author_facet Stranieri, Francesco
Stella, Fabio
contents In this study, we analyze and compare the performance of state-of-the-art deep reinforcement learning algorithms for solving the supply chain inventory management problem. This complex sequential decision-making problem consists of determining the optimal quantity of products to be produced and shipped across different warehouses over a given time horizon. In particular, we present a mathematical formulation of a two-echelon supply chain environment with stochastic and seasonal demand, which allows managing an arbitrary number of warehouses and product types. Through a rich set of numerical experiments, we compare the performance of different deep reinforcement learning algorithms under various supply chain structures, topologies, demands, capacities, and costs. The results of the experimental plan indicate that deep reinforcement learning algorithms outperform traditional inventory management strategies, such as the static (s, Q)-policy. Furthermore, this study provides detailed insight into the design and development of an open-source software library that provides a customizable environment for solving the supply chain inventory management problem using a wide range of data-driven approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2204_09603
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Comparing Deep Reinforcement Learning Algorithms in Two-Echelon Supply Chains
Stranieri, Francesco
Stella, Fabio
Machine Learning
Artificial Intelligence
Optimization and Control
68T07 (Primary), 90B06, 90B05 (Secondary)
In this study, we analyze and compare the performance of state-of-the-art deep reinforcement learning algorithms for solving the supply chain inventory management problem. This complex sequential decision-making problem consists of determining the optimal quantity of products to be produced and shipped across different warehouses over a given time horizon. In particular, we present a mathematical formulation of a two-echelon supply chain environment with stochastic and seasonal demand, which allows managing an arbitrary number of warehouses and product types. Through a rich set of numerical experiments, we compare the performance of different deep reinforcement learning algorithms under various supply chain structures, topologies, demands, capacities, and costs. The results of the experimental plan indicate that deep reinforcement learning algorithms outperform traditional inventory management strategies, such as the static (s, Q)-policy. Furthermore, this study provides detailed insight into the design and development of an open-source software library that provides a customizable environment for solving the supply chain inventory management problem using a wide range of data-driven approaches.
title Comparing Deep Reinforcement Learning Algorithms in Two-Echelon Supply Chains
topic Machine Learning
Artificial Intelligence
Optimization and Control
68T07 (Primary), 90B06, 90B05 (Secondary)
url https://arxiv.org/abs/2204.09603