Reinforcement Learning for Dynamic Resource Allocation in Optical Networks: Hype or Hope?
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913801996075008 |
|---|---|
| author | Doherty, Michael Matzner, Robin Sadeghi, Rasoul Bayvel, Polina Beghelli, Alejandra |
| author_facet | Doherty, Michael Matzner, Robin Sadeghi, Rasoul Bayvel, Polina Beghelli, Alejandra |
| contents | The application of reinforcement learning (RL) to dynamic resource allocation in optical networks has been the focus of intense research activity in recent years, with almost 100 peer-reviewed papers. We present a review of progress in the field, and identify significant gaps in benchmarking practices and reproducibility. To determine the strongest benchmark algorithms, we systematically evaluate several heuristics across diverse network topologies. We find that path count and sort criteria for path selection significantly affect the benchmark performance. We meticulously recreate the problems from five landmark papers and apply the improved benchmarks. Our comparisons demonstrate that simple heuristics consistently match or outperform the published RL solutions, often with an order of magnitude lower blocking probability. Furthermore, we present empirical lower bounds on network blocking using a novel defragmentation-based method, revealing that potential improvements over the benchmark heuristics are limited to 19-36% increased traffic load for the same blocking performance in our examples. We make our simulation framework and results publicly available to promote reproducible research and standardized evaluation https://doi.org/10.5281/zenodo.12594495. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_12804 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Reinforcement Learning for Dynamic Resource Allocation in Optical Networks: Hype or Hope? Doherty, Michael Matzner, Robin Sadeghi, Rasoul Bayvel, Polina Beghelli, Alejandra Networking and Internet Architecture Machine Learning Systems and Control The application of reinforcement learning (RL) to dynamic resource allocation in optical networks has been the focus of intense research activity in recent years, with almost 100 peer-reviewed papers. We present a review of progress in the field, and identify significant gaps in benchmarking practices and reproducibility. To determine the strongest benchmark algorithms, we systematically evaluate several heuristics across diverse network topologies. We find that path count and sort criteria for path selection significantly affect the benchmark performance. We meticulously recreate the problems from five landmark papers and apply the improved benchmarks. Our comparisons demonstrate that simple heuristics consistently match or outperform the published RL solutions, often with an order of magnitude lower blocking probability. Furthermore, we present empirical lower bounds on network blocking using a novel defragmentation-based method, revealing that potential improvements over the benchmark heuristics are limited to 19-36% increased traffic load for the same blocking performance in our examples. We make our simulation framework and results publicly available to promote reproducible research and standardized evaluation https://doi.org/10.5281/zenodo.12594495. |
| title | Reinforcement Learning for Dynamic Resource Allocation in Optical Networks: Hype or Hope? |
| topic | Networking and Internet Architecture Machine Learning Systems and Control |
| url | https://arxiv.org/abs/2502.12804 |