From Heuristic Selection to Automated Algorithm Design: LLMs Benefit from Strong Priors
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915830953934848 |
|---|---|
| author | Huang, Qi Ye, Furong Shahane, Ananta Bäck, Thomas van Stein, Niki |
| author_facet | Huang, Qi Ye, Furong Shahane, Ananta Bäck, Thomas van Stein, Niki |
| contents | Large Language Models (LLMs) have already been widely adopted for automated algorithm design, demonstrating strong abilities in generating and evolving algorithms across various fields. Existing work has largely focused on examining their effectiveness in solving specific problems, with search strategies primarily guided by adaptive prompt designs. In this paper, through investigating the token-wise attribution of the prompts to LLM-generated algorithmic codes, we show that providing high-quality algorithmic code examples can substantially improve the performance of the LLM-driven optimization. Building upon this insight, we propose leveraging prior benchmark algorithms to guide LLM-driven optimization and demonstrate superior performance on two black-box optimization benchmarks: the pseudo-Boolean optimization suite (pbo) and the black-box optimization suite (bbob). Our findings highlight the value of integrating benchmarking studies to enhance both efficiency and robustness of the LLM-driven black-box optimization methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_02792 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | From Heuristic Selection to Automated Algorithm Design: LLMs Benefit from Strong Priors Huang, Qi Ye, Furong Shahane, Ananta Bäck, Thomas van Stein, Niki Machine Learning Neural and Evolutionary Computing Large Language Models (LLMs) have already been widely adopted for automated algorithm design, demonstrating strong abilities in generating and evolving algorithms across various fields. Existing work has largely focused on examining their effectiveness in solving specific problems, with search strategies primarily guided by adaptive prompt designs. In this paper, through investigating the token-wise attribution of the prompts to LLM-generated algorithmic codes, we show that providing high-quality algorithmic code examples can substantially improve the performance of the LLM-driven optimization. Building upon this insight, we propose leveraging prior benchmark algorithms to guide LLM-driven optimization and demonstrate superior performance on two black-box optimization benchmarks: the pseudo-Boolean optimization suite (pbo) and the black-box optimization suite (bbob). Our findings highlight the value of integrating benchmarking studies to enhance both efficiency and robustness of the LLM-driven black-box optimization methods. |
| title | From Heuristic Selection to Automated Algorithm Design: LLMs Benefit from Strong Priors |
| topic | Machine Learning Neural and Evolutionary Computing |
| url | https://arxiv.org/abs/2603.02792 |