Open-Ended Task Discovery via Bayesian Optimization

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Adachi, Masaki, Suzuki, Yuta, Ziomek, Juliusz
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914543595159552
author Adachi, Masaki
Suzuki, Yuta
Ziomek, Juliusz
author_facet Adachi, Masaki
Suzuki, Yuta
Ziomek, Juliusz
contents When applying Bayesian optimization (BO) to scientific workflow, a major yet often overlooked source of uncertainty is the task itself -- namely, what to optimize and how to evaluate it -- which can evolve as evidence accumulates. We introduce Generate-Select-Refine (GSR), a open-ended BO framework that alternates between task generation and task optimization. Starting from a user-provided seed task, GSR generates new tasks in a coarse-to-fine manner while a task-acquisition function schedules optimization. Asymptotically, it concentrates evaluations on the best task, incurring only logarithmic regret overhead relative to single-task BO. We apply GSR to new product development, chemical synthesis scaling, algorithm analysis, and patent repurposing, where it outperforms existing LLM-based optimizers.
format Preprint
id arxiv_https___arxiv_org_abs_2605_07572
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Open-Ended Task Discovery via Bayesian Optimization
Adachi, Masaki
Suzuki, Yuta
Ziomek, Juliusz
Artificial Intelligence
Machine Learning
62C10, 62F15
When applying Bayesian optimization (BO) to scientific workflow, a major yet often overlooked source of uncertainty is the task itself -- namely, what to optimize and how to evaluate it -- which can evolve as evidence accumulates. We introduce Generate-Select-Refine (GSR), a open-ended BO framework that alternates between task generation and task optimization. Starting from a user-provided seed task, GSR generates new tasks in a coarse-to-fine manner while a task-acquisition function schedules optimization. Asymptotically, it concentrates evaluations on the best task, incurring only logarithmic regret overhead relative to single-task BO. We apply GSR to new product development, chemical synthesis scaling, algorithm analysis, and patent repurposing, where it outperforms existing LLM-based optimizers.
title Open-Ended Task Discovery via Bayesian Optimization
topic Artificial Intelligence
Machine Learning
62C10, 62F15
url https://arxiv.org/abs/2605.07572