CMA-ES for Discrete and Mixed-Variable Optimization on Sets of Points

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Uchida, Kento, Hamano, Ryoki, Nomura, Masahiro, Saito, Shota, Shirakawa, Shinichi
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916367635054592
author Uchida, Kento
Hamano, Ryoki
Nomura, Masahiro
Saito, Shota
Shirakawa, Shinichi
author_facet Uchida, Kento
Hamano, Ryoki
Nomura, Masahiro
Saito, Shota
Shirakawa, Shinichi
contents Discrete and mixed-variable optimization problems have appeared in several real-world applications. Most of the research on mixed-variable optimization considers a mixture of integer and continuous variables, and several integer handlings have been developed to inherit the optimization performance of the continuous optimization methods to mixed-integer optimization. In some applications, acceptable solutions are given by selecting possible points in the disjoint subspaces. This paper focuses on the optimization on sets of points and proposes an optimization method by extending the covariance matrix adaptation evolution strategy (CMA-ES), termed the CMA-ES on sets of points (CMA-ES-SoP). The CMA-ES-SoP incorporates margin correction that maintains the generation probability of neighboring points to prevent premature convergence to a specific non-optimal point, which is an effective integer-handling technique for CMA-ES. In addition, because margin correction with a fixed margin value tends to increase the marginal probabilities for a portion of neighboring points more than necessary, the CMA-ES-SoP updates the target margin value adaptively to make the average of the marginal probabilities close to a predefined target probability. Numerical simulations demonstrated that the CMA-ES-SoP successfully optimized the optimization problems on sets of points, whereas the naive CMA-ES failed to optimize them due to premature convergence.
format Preprint
id arxiv_https___arxiv_org_abs_2408_13046
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle CMA-ES for Discrete and Mixed-Variable Optimization on Sets of Points
Uchida, Kento
Hamano, Ryoki
Nomura, Masahiro
Saito, Shota
Shirakawa, Shinichi
Optimization and Control
Neural and Evolutionary Computing
Discrete and mixed-variable optimization problems have appeared in several real-world applications. Most of the research on mixed-variable optimization considers a mixture of integer and continuous variables, and several integer handlings have been developed to inherit the optimization performance of the continuous optimization methods to mixed-integer optimization. In some applications, acceptable solutions are given by selecting possible points in the disjoint subspaces. This paper focuses on the optimization on sets of points and proposes an optimization method by extending the covariance matrix adaptation evolution strategy (CMA-ES), termed the CMA-ES on sets of points (CMA-ES-SoP). The CMA-ES-SoP incorporates margin correction that maintains the generation probability of neighboring points to prevent premature convergence to a specific non-optimal point, which is an effective integer-handling technique for CMA-ES. In addition, because margin correction with a fixed margin value tends to increase the marginal probabilities for a portion of neighboring points more than necessary, the CMA-ES-SoP updates the target margin value adaptively to make the average of the marginal probabilities close to a predefined target probability. Numerical simulations demonstrated that the CMA-ES-SoP successfully optimized the optimization problems on sets of points, whereas the naive CMA-ES failed to optimize them due to premature convergence.
title CMA-ES for Discrete and Mixed-Variable Optimization on Sets of Points
topic Optimization and Control
Neural and Evolutionary Computing
url https://arxiv.org/abs/2408.13046