MO-IOHinspector: Anytime Benchmarking of Multi-Objective Algorithms using IOHprofiler
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913605778145280 |
|---|---|
| author | Vermetten, Diederick Rook, Jeroen Preuß, Oliver L. de Nobel, Jacob Doerr, Carola López-Ibañez, Manuel Trautmann, Heike Bäck, Thomas |
| author_facet | Vermetten, Diederick Rook, Jeroen Preuß, Oliver L. de Nobel, Jacob Doerr, Carola López-Ibañez, Manuel Trautmann, Heike Bäck, Thomas |
| contents | Benchmarking is one of the key ways in which we can gain insight into the strengths and weaknesses of optimization algorithms. In sampling-based optimization, considering the anytime behavior of an algorithm can provide valuable insights for further developments. In the context of multi-objective optimization, this anytime perspective is not as widely adopted as in the single-objective context. In this paper, we propose a new software tool which uses principles from unbounded archiving as a logging structure. This leads to a clearer separation between experimental design and subsequent analysis decisions. We integrate this approach as a new Python module into the IOHprofiler framework and demonstrate the benefits of this approach by showcasing the ability to change indicators, aggregations, and ranking procedures during the analysis pipeline. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_07444 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MO-IOHinspector: Anytime Benchmarking of Multi-Objective Algorithms using IOHprofiler Vermetten, Diederick Rook, Jeroen Preuß, Oliver L. de Nobel, Jacob Doerr, Carola López-Ibañez, Manuel Trautmann, Heike Bäck, Thomas Neural and Evolutionary Computing Benchmarking is one of the key ways in which we can gain insight into the strengths and weaknesses of optimization algorithms. In sampling-based optimization, considering the anytime behavior of an algorithm can provide valuable insights for further developments. In the context of multi-objective optimization, this anytime perspective is not as widely adopted as in the single-objective context. In this paper, we propose a new software tool which uses principles from unbounded archiving as a logging structure. This leads to a clearer separation between experimental design and subsequent analysis decisions. We integrate this approach as a new Python module into the IOHprofiler framework and demonstrate the benefits of this approach by showcasing the ability to change indicators, aggregations, and ranking procedures during the analysis pipeline. |
| title | MO-IOHinspector: Anytime Benchmarking of Multi-Objective Algorithms using IOHprofiler |
| topic | Neural and Evolutionary Computing |
| url | https://arxiv.org/abs/2412.07444 |