Deep RL Dual Sourcing Inventory Management with Supply and Capacity Risk Awareness

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Defeng, Liu, Ying, Eisenach, Carson
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911365068750848
author Liu, Defeng
Liu, Ying
Eisenach, Carson
author_facet Liu, Defeng
Liu, Ying
Eisenach, Carson
contents In this work, we study how to efficiently apply reinforcement learning (RL) for solving large-scale stochastic optimization problems by leveraging intervention models. The key of the proposed methodology is to better explore the solution space by simulating and composing the stochastic processes using pre-trained deep learning (DL) models. We demonstrate our approach on a challenging real-world application, the multi-sourcing multi-period inventory management problem in supply chain optimization. In particular, we employ deep RL models for learning and forecasting the stochastic supply chain processes under a range of assumptions. Moreover, we also introduce a constraint coordination mechanism, designed to forecast dual costs given the cross-products constraints in the inventory network. We highlight that instead of directly modeling the complex physical constraints into the RL optimization problem and solving the stochastic problem as a whole, our approach breaks down those supply chain processes into scalable and composable DL modules, leading to improved performance on large real-world datasets. We also outline open problems for future research to further investigate the efficacy of such models.
format Preprint
id arxiv_https___arxiv_org_abs_2507_14446
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Deep RL Dual Sourcing Inventory Management with Supply and Capacity Risk Awareness
Liu, Defeng
Liu, Ying
Eisenach, Carson
Machine Learning
In this work, we study how to efficiently apply reinforcement learning (RL) for solving large-scale stochastic optimization problems by leveraging intervention models. The key of the proposed methodology is to better explore the solution space by simulating and composing the stochastic processes using pre-trained deep learning (DL) models. We demonstrate our approach on a challenging real-world application, the multi-sourcing multi-period inventory management problem in supply chain optimization. In particular, we employ deep RL models for learning and forecasting the stochastic supply chain processes under a range of assumptions. Moreover, we also introduce a constraint coordination mechanism, designed to forecast dual costs given the cross-products constraints in the inventory network. We highlight that instead of directly modeling the complex physical constraints into the RL optimization problem and solving the stochastic problem as a whole, our approach breaks down those supply chain processes into scalable and composable DL modules, leading to improved performance on large real-world datasets. We also outline open problems for future research to further investigate the efficacy of such models.
title Deep RL Dual Sourcing Inventory Management with Supply and Capacity Risk Awareness
topic Machine Learning
url https://arxiv.org/abs/2507.14446