Divide and Learn: Multi-Objective Combinatorial Optimization at Scale

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Singh, Esha, Wu, Dongxia, Yang, Chien-Yi, Rosing, Tajana, Yu, Rose, Ma, Yi-An
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914324022296576
author Singh, Esha
Wu, Dongxia
Yang, Chien-Yi
Rosing, Tajana
Yu, Rose
Ma, Yi-An
author_facet Singh, Esha
Wu, Dongxia
Yang, Chien-Yi
Rosing, Tajana
Yu, Rose
Ma, Yi-An
contents Multi-objective combinatorial optimization seeks Pareto-optimal solutions over exponentially large discrete spaces, yet existing methods sacrifice generality, scalability, or theoretical guarantees. We reformulate it as an online learning problem over a decomposed decision space, solving position-wise bandit subproblems via adaptive expert-guided sequential construction. This formulation admits regret bounds of $O(d\sqrt{T \log T})$ depending on subproblem dimensionality \(d\) rather than combinatorial space size. On standard benchmarks, our method achieves 80--98\% of specialized solvers performance while achieving two to three orders of magnitude improvement in sample and computational efficiency over Bayesian optimization methods. On real-world hardware-software co-design for AI accelerators with expensive simulations, we outperform competing methods under fixed evaluation budgets. The advantage grows with problem scale and objective count, establishing bandit optimization over decomposed decision spaces as a principled alternative to surrogate modeling or offline training for multi-objective optimization.
format Preprint
id arxiv_https___arxiv_org_abs_2602_11346
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Divide and Learn: Multi-Objective Combinatorial Optimization at Scale
Singh, Esha
Wu, Dongxia
Yang, Chien-Yi
Rosing, Tajana
Yu, Rose
Ma, Yi-An
Machine Learning
Artificial Intelligence
Multi-objective combinatorial optimization seeks Pareto-optimal solutions over exponentially large discrete spaces, yet existing methods sacrifice generality, scalability, or theoretical guarantees. We reformulate it as an online learning problem over a decomposed decision space, solving position-wise bandit subproblems via adaptive expert-guided sequential construction. This formulation admits regret bounds of $O(d\sqrt{T \log T})$ depending on subproblem dimensionality \(d\) rather than combinatorial space size. On standard benchmarks, our method achieves 80--98\% of specialized solvers performance while achieving two to three orders of magnitude improvement in sample and computational efficiency over Bayesian optimization methods. On real-world hardware-software co-design for AI accelerators with expensive simulations, we outperform competing methods under fixed evaluation budgets. The advantage grows with problem scale and objective count, establishing bandit optimization over decomposed decision spaces as a principled alternative to surrogate modeling or offline training for multi-objective optimization.
title Divide and Learn: Multi-Objective Combinatorial Optimization at Scale
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2602.11346