Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2512.16491 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909970573819904 |
|---|---|
| author | Eimer, Theresa Schäpermeier, Lennart Biedenkapp, André Tornede, Alexander Kotthoff, Lars Leyman, Pieter Feurer, Matthias Eggensperger, Katharina Maile, Kaitlin Tornede, Tanja Kozak, Anna Xue, Ke Wever, Marcel Baratchi, Mitra Pulatov, Damir Trautmann, Heike Kashgarani, Haniye Lindauer, Marius |
| author_facet | Eimer, Theresa Schäpermeier, Lennart Biedenkapp, André Tornede, Alexander Kotthoff, Lars Leyman, Pieter Feurer, Matthias Eggensperger, Katharina Maile, Kaitlin Tornede, Tanja Kozak, Anna Xue, Ke Wever, Marcel Baratchi, Mitra Pulatov, Damir Trautmann, Heike Kashgarani, Haniye Lindauer, Marius |
| contents | Empirical research on meta-algorithmics, such as algorithm selection, configuration, and scheduling, often relies on extensive and thus computationally expensive experiments. With the large degree of freedom we have over our experimental setup and design comes a plethora of possible error sources that threaten the scalability and validity of our scientific insights. Best practices for meta-algorithmic research exist, but they are scattered between different publications and fields, and continue to evolve separately from each other. In this report, we collect good practices for empirical meta-algorithmic research across the subfields of the COSEAL community, encompassing the entire experimental cycle: from formulating research questions and selecting an experimental design, to executing experiments, and ultimately, analyzing and presenting results impartially. It establishes the current state-of-the-art practices within meta-algorithmic research and serves as a guideline to both new researchers and practitioners in meta-algorithmic fields. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_16491 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Best Practices For Empirical Meta-Algorithmic Research: Guidelines from the COSEAL Research Network Eimer, Theresa Schäpermeier, Lennart Biedenkapp, André Tornede, Alexander Kotthoff, Lars Leyman, Pieter Feurer, Matthias Eggensperger, Katharina Maile, Kaitlin Tornede, Tanja Kozak, Anna Xue, Ke Wever, Marcel Baratchi, Mitra Pulatov, Damir Trautmann, Heike Kashgarani, Haniye Lindauer, Marius Artificial Intelligence Empirical research on meta-algorithmics, such as algorithm selection, configuration, and scheduling, often relies on extensive and thus computationally expensive experiments. With the large degree of freedom we have over our experimental setup and design comes a plethora of possible error sources that threaten the scalability and validity of our scientific insights. Best practices for meta-algorithmic research exist, but they are scattered between different publications and fields, and continue to evolve separately from each other. In this report, we collect good practices for empirical meta-algorithmic research across the subfields of the COSEAL community, encompassing the entire experimental cycle: from formulating research questions and selecting an experimental design, to executing experiments, and ultimately, analyzing and presenting results impartially. It establishes the current state-of-the-art practices within meta-algorithmic research and serves as a guideline to both new researchers and practitioners in meta-algorithmic fields. |
| title | Best Practices For Empirical Meta-Algorithmic Research: Guidelines from the COSEAL Research Network |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2512.16491 |