A Cubic Regularization Method for Multiobjective Optimization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gonçalves, Douglas S., Gonçalves, Max L. N., Melo, Jefferson G.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912422301794304
author Gonçalves, Douglas S.
Gonçalves, Max L. N.
Melo, Jefferson G.
author_facet Gonçalves, Douglas S.
Gonçalves, Max L. N.
Melo, Jefferson G.
contents This work introduces a new cubic regularization method for nonconvex unconstrained multiobjective optimization problems. At each iteration of the method, a model associated with the cubic regularization of each component of the objective function is minimized. This model allows approximations for the first- and second-order derivatives, which must satisfy suitable error conditions. One interesting feature of the proposed algorithm is that the regularization parameter of the model and the accuracy of the derivative approximations are jointly adjusted using a nonmonotone line search criterion. Implementations of the method, where derivative information is computed using finite difference strategies, are discussed. It is shown that, under the assumption that the Hessians of the objectives are globally Lipschitz continuous, the method requires at most $\mathcal{O}(Cε^{-3/2})$ iterations to generate an $ε$-approximate Pareto critical. In particular, if the first- and second-order derivative information is computed using finite differences based solely on function values, the method requires at most $\mathcal{O}(n^{1-β}ε^{-3/2})$ iterations, corresponding to $\mathcal{O}\left(mn^{3-β}\varepsilon^{-\frac{3}{2}}\right)$ function evaluations, where \(n\) is the dimension of the domain of the objective function, $m$ is the number of objectives, and $β\in [0,1]$ is a constant associated with the stepsize used in the finite-difference approximation. We further discuss the global convergence and local convergence rate of the method. Specifically, under the local convexity assumption, we show that the method achieves superlinear convergence when the first derivative is computed exactly, and quadratic convergence when both first- and second-order derivatives are exact.
format Preprint
id arxiv_https___arxiv_org_abs_2506_08181
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Cubic Regularization Method for Multiobjective Optimization
Gonçalves, Douglas S.
Gonçalves, Max L. N.
Melo, Jefferson G.
Optimization and Control
49M15, 65K05, 90C26, 90C29
This work introduces a new cubic regularization method for nonconvex unconstrained multiobjective optimization problems. At each iteration of the method, a model associated with the cubic regularization of each component of the objective function is minimized. This model allows approximations for the first- and second-order derivatives, which must satisfy suitable error conditions. One interesting feature of the proposed algorithm is that the regularization parameter of the model and the accuracy of the derivative approximations are jointly adjusted using a nonmonotone line search criterion. Implementations of the method, where derivative information is computed using finite difference strategies, are discussed. It is shown that, under the assumption that the Hessians of the objectives are globally Lipschitz continuous, the method requires at most $\mathcal{O}(Cε^{-3/2})$ iterations to generate an $ε$-approximate Pareto critical. In particular, if the first- and second-order derivative information is computed using finite differences based solely on function values, the method requires at most $\mathcal{O}(n^{1-β}ε^{-3/2})$ iterations, corresponding to $\mathcal{O}\left(mn^{3-β}\varepsilon^{-\frac{3}{2}}\right)$ function evaluations, where \(n\) is the dimension of the domain of the objective function, $m$ is the number of objectives, and $β\in [0,1]$ is a constant associated with the stepsize used in the finite-difference approximation. We further discuss the global convergence and local convergence rate of the method. Specifically, under the local convexity assumption, we show that the method achieves superlinear convergence when the first derivative is computed exactly, and quadratic convergence when both first- and second-order derivatives are exact.
title A Cubic Regularization Method for Multiobjective Optimization
topic Optimization and Control
49M15, 65K05, 90C26, 90C29
url https://arxiv.org/abs/2506.08181