Saved in:
Bibliographic Details
Main Authors: Guo, Zhendong, Liu, Haitao, Ong, Yew-Soon, Qu, Xinghua, Zhang, Yuzhe, Zheng, Jianmin
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2501.13337
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915117601390592
author Guo, Zhendong
Liu, Haitao
Ong, Yew-Soon
Qu, Xinghua
Zhang, Yuzhe
Zheng, Jianmin
author_facet Guo, Zhendong
Liu, Haitao
Ong, Yew-Soon
Qu, Xinghua
Zhang, Yuzhe
Zheng, Jianmin
contents Many real-world problems, such as airfoil design, involve optimizing a black-box expensive objective function over complex structured input space (e.g., discrete space or non-Euclidean space). By mapping the complex structured input space into a latent space of dozens of variables, a two-stage procedure labeled as generative model based optimization (GMO) in this paper, shows promise in solving such problems. However, the latent dimension of GMO is hard to determine, which may trigger the conflicting issue between desirable solution accuracy and convergence rate. To address the above issue, we propose a multi-form GMO approach, namely generative multi-form optimization (GMFoO), which conducts optimization over multiple latent spaces simultaneously to complement each other. More specifically, we devise a generative model which promotes positive correlation between latent spaces to facilitate effective knowledge transfer in GMFoO. And further, by using Bayesian optimization (BO) as the optimizer, we propose two strategies to exchange information between these latent spaces continuously. Experimental results are presented on airfoil and corbel design problems and an area maximization problem as well to demonstrate that our proposed GMFoO converges to better designs on a limited computational budget.
format Preprint
id arxiv_https___arxiv_org_abs_2501_13337
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Generative Multi-Form Bayesian Optimization
Guo, Zhendong
Liu, Haitao
Ong, Yew-Soon
Qu, Xinghua
Zhang, Yuzhe
Zheng, Jianmin
Computational Engineering, Finance, and Science
Many real-world problems, such as airfoil design, involve optimizing a black-box expensive objective function over complex structured input space (e.g., discrete space or non-Euclidean space). By mapping the complex structured input space into a latent space of dozens of variables, a two-stage procedure labeled as generative model based optimization (GMO) in this paper, shows promise in solving such problems. However, the latent dimension of GMO is hard to determine, which may trigger the conflicting issue between desirable solution accuracy and convergence rate. To address the above issue, we propose a multi-form GMO approach, namely generative multi-form optimization (GMFoO), which conducts optimization over multiple latent spaces simultaneously to complement each other. More specifically, we devise a generative model which promotes positive correlation between latent spaces to facilitate effective knowledge transfer in GMFoO. And further, by using Bayesian optimization (BO) as the optimizer, we propose two strategies to exchange information between these latent spaces continuously. Experimental results are presented on airfoil and corbel design problems and an area maximization problem as well to demonstrate that our proposed GMFoO converges to better designs on a limited computational budget.
title Generative Multi-Form Bayesian Optimization
topic Computational Engineering, Finance, and Science
url https://arxiv.org/abs/2501.13337