Bandits attack function optimization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Preux, Philippe, Munos, Rémi, Valko, Michal
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914530466988032
author Preux, Philippe
Munos, Rémi
Valko, Michal
author_facet Preux, Philippe
Munos, Rémi
Valko, Michal
contents We consider function optimization as a sequential decision making problem under budget constraint. This constraint limits the number of objective function evaluations allowed during the optimization. We consider an algorithm inspired by a continuous version of a multi-armed bandit problem which attacks this optimization problem by solving the tradeoff between exploration (initial quasi-uniform search of the domain) and exploitation (local optimization around the potentially global maxima). We introduce the so-called Simultaneous Optimistic Optimization (SOO), a deterministic algorithm that works by domain partitioning. The benefit of such approach are the guarantees on the returned solution and the numerical efficiency of the algorithm. We present this machine learning approach to optimization, and provide the empirical assessment of SOO on the CEC'2014 competition on single objective real-parameter numerical optimization test-suite.
format Preprint
id arxiv_https___arxiv_org_abs_2605_03496
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Bandits attack function optimization
Preux, Philippe
Munos, Rémi
Valko, Michal
Machine Learning
We consider function optimization as a sequential decision making problem under budget constraint. This constraint limits the number of objective function evaluations allowed during the optimization. We consider an algorithm inspired by a continuous version of a multi-armed bandit problem which attacks this optimization problem by solving the tradeoff between exploration (initial quasi-uniform search of the domain) and exploitation (local optimization around the potentially global maxima). We introduce the so-called Simultaneous Optimistic Optimization (SOO), a deterministic algorithm that works by domain partitioning. The benefit of such approach are the guarantees on the returned solution and the numerical efficiency of the algorithm. We present this machine learning approach to optimization, and provide the empirical assessment of SOO on the CEC'2014 competition on single objective real-parameter numerical optimization test-suite.
title Bandits attack function optimization
topic Machine Learning
url https://arxiv.org/abs/2605.03496