Primal-dual extrapolation methods for monotone inclusions under local Lipschitz continuity

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lu, Zhaosong, Mei, Sanyou
Formato: Preprint
Publicado: 2022
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909301608546304
author Lu, Zhaosong
Mei, Sanyou
author_facet Lu, Zhaosong
Mei, Sanyou
contents In this paper we consider a class of monotone inclusion (MI) problems of finding a zero of the sum of two monotone operators, in which one operator is maximal monotone while the other is {\it locally Lipschitz} continuous. We propose primal-dual extrapolation methods to solve them using a point and operator extrapolation technique, whose parameters are chosen by a backtracking line search scheme. The proposed methods enjoy an operation complexity of ${\cal O}(\log ε^{-1})$ and ${\cal O}(ε^{-1}\log ε^{-1})$, measured by the number of fundamental operations consisting only of evaluations of one operator and resolvent of the other operator, for finding an $\varepsilon$-residual solution of strongly and non-strongly MI problems, respectively. The latter complexity significantly improves the previously best operation complexity ${\cal O}(\varepsilon^{-2})$. As a byproduct, complexity results of the primal-dual extrapolation methods are also obtained for finding an $\varepsilon$-KKT or $\varepsilon$-residual solution of convex conic optimization, conic constrained saddle point, and variational inequality problems under {\it local Lipschitz} continuity. We provide preliminary numerical results to demonstrate the performance of the proposed methods.
format Preprint
id arxiv_https___arxiv_org_abs_2206_00973
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Primal-dual extrapolation methods for monotone inclusions under local Lipschitz continuity
Lu, Zhaosong
Mei, Sanyou
Optimization and Control
Machine Learning
Numerical Analysis
47H05, 47J20, 49M29, 65K15, 90C25
In this paper we consider a class of monotone inclusion (MI) problems of finding a zero of the sum of two monotone operators, in which one operator is maximal monotone while the other is {\it locally Lipschitz} continuous. We propose primal-dual extrapolation methods to solve them using a point and operator extrapolation technique, whose parameters are chosen by a backtracking line search scheme. The proposed methods enjoy an operation complexity of ${\cal O}(\log ε^{-1})$ and ${\cal O}(ε^{-1}\log ε^{-1})$, measured by the number of fundamental operations consisting only of evaluations of one operator and resolvent of the other operator, for finding an $\varepsilon$-residual solution of strongly and non-strongly MI problems, respectively. The latter complexity significantly improves the previously best operation complexity ${\cal O}(\varepsilon^{-2})$. As a byproduct, complexity results of the primal-dual extrapolation methods are also obtained for finding an $\varepsilon$-KKT or $\varepsilon$-residual solution of convex conic optimization, conic constrained saddle point, and variational inequality problems under {\it local Lipschitz} continuity. We provide preliminary numerical results to demonstrate the performance of the proposed methods.
title Primal-dual extrapolation methods for monotone inclusions under local Lipschitz continuity
topic Optimization and Control
Machine Learning
Numerical Analysis
47H05, 47J20, 49M29, 65K15, 90C25
url https://arxiv.org/abs/2206.00973