A Benchmark Study of Deep Reinforcement Learning Algorithms for the Container Stowage Planning Problem
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918153610592256 |
|---|---|
| author | Huang, Yunqi Chennakeshava, Nishith Carras, Alexis Neverov, Vladislav Liu, Wei Plaat, Aske Fan, Yingjie |
| author_facet | Huang, Yunqi Chennakeshava, Nishith Carras, Alexis Neverov, Vladislav Liu, Wei Plaat, Aske Fan, Yingjie |
| contents | Container stowage planning (CSPP) is a critical component of maritime transportation and terminal operations, directly affecting supply chain efficiency. Owing to its complexity, CSPP has traditionally relied on human expertise. While reinforcement learning (RL) has recently been applied to CSPP, systematic benchmark comparisons across different algorithms remain limited. To address this gap, we develop a Gym environment that captures the fundamental features of CSPP and extend it to include crane scheduling in both multi-agent and single-agent formulations. Within this framework, we evaluate five RL algorithms: DQN, QR-DQN, A2C, PPO, and TRPO under multiple scenarios of varying complexity. The results reveal distinct performance gaps with increasing complexity, underscoring the importance of algorithm choice and problem formulation for CSPP. Overall, this paper benchmarks multiple RL methods for CSPP while providing a reusable Gym environment with crane scheduling, thus offering a foundation for future research and practical deployment in maritime logistics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_02589 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Benchmark Study of Deep Reinforcement Learning Algorithms for the Container Stowage Planning Problem Huang, Yunqi Chennakeshava, Nishith Carras, Alexis Neverov, Vladislav Liu, Wei Plaat, Aske Fan, Yingjie Artificial Intelligence Container stowage planning (CSPP) is a critical component of maritime transportation and terminal operations, directly affecting supply chain efficiency. Owing to its complexity, CSPP has traditionally relied on human expertise. While reinforcement learning (RL) has recently been applied to CSPP, systematic benchmark comparisons across different algorithms remain limited. To address this gap, we develop a Gym environment that captures the fundamental features of CSPP and extend it to include crane scheduling in both multi-agent and single-agent formulations. Within this framework, we evaluate five RL algorithms: DQN, QR-DQN, A2C, PPO, and TRPO under multiple scenarios of varying complexity. The results reveal distinct performance gaps with increasing complexity, underscoring the importance of algorithm choice and problem formulation for CSPP. Overall, this paper benchmarks multiple RL methods for CSPP while providing a reusable Gym environment with crane scheduling, thus offering a foundation for future research and practical deployment in maritime logistics. |
| title | A Benchmark Study of Deep Reinforcement Learning Algorithms for the Container Stowage Planning Problem |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2510.02589 |