Surrogate Ensemble in Expensive Multi-Objective Optimization via Deep Q-Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wu, Yuxin, Guo, Hongshu, Huang, Ting, Gong, Yue-Jiao, Ma, Zeyuan
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917238451208192
author Wu, Yuxin
Guo, Hongshu
Huang, Ting
Gong, Yue-Jiao
Ma, Zeyuan
author_facet Wu, Yuxin
Guo, Hongshu
Huang, Ting
Gong, Yue-Jiao
Ma, Zeyuan
contents Surrogate-assisted Evolutionary Algorithms~(SAEAs) have shown promising robustness in solving expensive optimization problems. A key aspect that impacts SAEAs' effectiveness is surrogate model selection, which in existing works is predominantly decided by human developer. Such human-made design choice introduces strong bias into SAEAs and may hurt their expected performance on out-of-scope tasks. In this paper, we propose a reinforcement learning-assisted ensemble framework, termed as SEEMOO, which is capable of scheduling different surrogate models within a single optimization process, hence boosting the overall optimization performance in a cooperative paradigm. Specifically, we focus on expensive multi-objective optimization problems, where multiple objective functions shape a compositional landscape and hence challenge surrogate selection. SEEMOO comprises following core designs: 1) A pre-collected model pool that maintains different surrogate models; 2) An attention-based state-extractor supports universal optimization state representation of problems with varied objective numbers; 3) a deep Q-network serves as dynamic surrogate selector: Given the optimization state, it selects desired surrogate model for current-step evaluation. SEEMOO is trained to maximize the overall optimization performance under a training problem distribution. Extensive benchmark results demonstrate SEEMOO's surrogate ensemble paradigm boosts the optimization performance of single-surrogate baselines. Further ablation studies underscore the importance of SEEMOO's design components.
format Preprint
id arxiv_https___arxiv_org_abs_2602_00540
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Surrogate Ensemble in Expensive Multi-Objective Optimization via Deep Q-Learning
Wu, Yuxin
Guo, Hongshu
Huang, Ting
Gong, Yue-Jiao
Ma, Zeyuan
Neural and Evolutionary Computing
Machine Learning
Surrogate-assisted Evolutionary Algorithms~(SAEAs) have shown promising robustness in solving expensive optimization problems. A key aspect that impacts SAEAs' effectiveness is surrogate model selection, which in existing works is predominantly decided by human developer. Such human-made design choice introduces strong bias into SAEAs and may hurt their expected performance on out-of-scope tasks. In this paper, we propose a reinforcement learning-assisted ensemble framework, termed as SEEMOO, which is capable of scheduling different surrogate models within a single optimization process, hence boosting the overall optimization performance in a cooperative paradigm. Specifically, we focus on expensive multi-objective optimization problems, where multiple objective functions shape a compositional landscape and hence challenge surrogate selection. SEEMOO comprises following core designs: 1) A pre-collected model pool that maintains different surrogate models; 2) An attention-based state-extractor supports universal optimization state representation of problems with varied objective numbers; 3) a deep Q-network serves as dynamic surrogate selector: Given the optimization state, it selects desired surrogate model for current-step evaluation. SEEMOO is trained to maximize the overall optimization performance under a training problem distribution. Extensive benchmark results demonstrate SEEMOO's surrogate ensemble paradigm boosts the optimization performance of single-surrogate baselines. Further ablation studies underscore the importance of SEEMOO's design components.
title Surrogate Ensemble in Expensive Multi-Objective Optimization via Deep Q-Learning
topic Neural and Evolutionary Computing
Machine Learning
url https://arxiv.org/abs/2602.00540