Dynamic operator management in meta-heuristics using reinforcement learning: an application to permutation flowshop scheduling problems
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917759803195392 |
|---|---|
| author | Mamaghan, Maryam Karimi Mohammadi, Mehrdad Dullaert, Wout Vigo, Daniele Pirayesh, Amir |
| author_facet | Mamaghan, Maryam Karimi Mohammadi, Mehrdad Dullaert, Wout Vigo, Daniele Pirayesh, Amir |
| contents | This study develops a framework based on reinforcement learning to dynamically manage a large portfolio of search operators within meta-heuristics. Using the idea of tabu search, the framework allows for continuous adaptation by temporarily excluding less efficient operators and updating the portfolio composition during the search. A Q-learning-based adaptive operator selection mechanism is used to select the most suitable operator from the dynamically updated portfolio at each stage. Unlike traditional approaches, the proposed framework requires no input from the experts regarding the search operators, allowing domain-specific non-experts to effectively use the framework. The performance of the proposed framework is analyzed through an application to the permutation flowshop scheduling problem. The results demonstrate the superior performance of the proposed framework against state-of-the-art algorithms in terms of optimality gap and convergence speed. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_14864 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Dynamic operator management in meta-heuristics using reinforcement learning: an application to permutation flowshop scheduling problems Mamaghan, Maryam Karimi Mohammadi, Mehrdad Dullaert, Wout Vigo, Daniele Pirayesh, Amir Machine Learning This study develops a framework based on reinforcement learning to dynamically manage a large portfolio of search operators within meta-heuristics. Using the idea of tabu search, the framework allows for continuous adaptation by temporarily excluding less efficient operators and updating the portfolio composition during the search. A Q-learning-based adaptive operator selection mechanism is used to select the most suitable operator from the dynamically updated portfolio at each stage. Unlike traditional approaches, the proposed framework requires no input from the experts regarding the search operators, allowing domain-specific non-experts to effectively use the framework. The performance of the proposed framework is analyzed through an application to the permutation flowshop scheduling problem. The results demonstrate the superior performance of the proposed framework against state-of-the-art algorithms in terms of optimality gap and convergence speed. |
| title | Dynamic operator management in meta-heuristics using reinforcement learning: an application to permutation flowshop scheduling problems |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2408.14864 |