A Smoothing Consensus-Based Optimization Algorithm for Nonsmooth Nonconvex Optimization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wei, Jiazhen, Bian, Wei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915099407548416
author Wei, Jiazhen
Bian, Wei
author_facet Wei, Jiazhen
Bian, Wei
contents Lately, a novel swarm intelligence model, namely the consensus-based optimization (CBO) algorithm, was introduced to deal with the global optimization problems. Limited by the conditions of Ito's formula, the convergence analysis of the previous CBO finite particle system mainly focuses on the problem with smooth objective function. With the help of smoothing method, this paper achieves a breakthrough by proposing an effective CBO algorithm for solving the global solution of a nonconvex, nonsmooth, and possible non-Lipschitz continuous minimization problem with theoretical analysis, which dose not rely on the mean-field limit. We indicate that the proposed algorithm exhibits a global consensus and converges to a common state with any initial data. Then, we give a more detailed error estimation on the objective function values along the state of the proposed algorithm towards the global minimum. Finally, some numerical examples are presented to illustrate the appreciable performance of the proposed method on solving the nonsmooth, nonconvex minimization problems.
format Preprint
id arxiv_https___arxiv_org_abs_2501_06804
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Smoothing Consensus-Based Optimization Algorithm for Nonsmooth Nonconvex Optimization
Wei, Jiazhen
Bian, Wei
Optimization and Control
Lately, a novel swarm intelligence model, namely the consensus-based optimization (CBO) algorithm, was introduced to deal with the global optimization problems. Limited by the conditions of Ito's formula, the convergence analysis of the previous CBO finite particle system mainly focuses on the problem with smooth objective function. With the help of smoothing method, this paper achieves a breakthrough by proposing an effective CBO algorithm for solving the global solution of a nonconvex, nonsmooth, and possible non-Lipschitz continuous minimization problem with theoretical analysis, which dose not rely on the mean-field limit. We indicate that the proposed algorithm exhibits a global consensus and converges to a common state with any initial data. Then, we give a more detailed error estimation on the objective function values along the state of the proposed algorithm towards the global minimum. Finally, some numerical examples are presented to illustrate the appreciable performance of the proposed method on solving the nonsmooth, nonconvex minimization problems.
title A Smoothing Consensus-Based Optimization Algorithm for Nonsmooth Nonconvex Optimization
topic Optimization and Control
url https://arxiv.org/abs/2501.06804