Local Convergence Analysis of ADMM for Nonconvex Composite Optimization

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Xie, Xiyuan, Yang, Lihua, li, Qia
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918401198260224
author Xie, Xiyuan
Yang, Lihua
li, Qia
author_facet Xie, Xiyuan
Yang, Lihua
li, Qia
contents In this paper, we study the local convergence of the standard ADMM scheme for a class of nonconvex composite problems arising from modern imaging and machine learning models. This problem is constrained by a closed convex set, while its objective is the sum of a continuously differentiable (possibly nonconvex) smooth term and a polyhedral convex nonsmooth term composed with a linear mapping. Our analysis is mainly motivated by the recent works of Rockafellar [29,30]. We begin with an elementary proof of a key local strong convexity property of the Moreau envelope of polyhedral convex functions. Building on this property, we show that the strong variational sufficiency condition holds for the considered problem under appropriate assumptions. Using the strong variational sufficiency condition, we further derive a descent inequality for the ADMM iterates, in a form analogous to the classical descent analysis of ADMM for convex problems. As a consequence, for a suitable choice of the penalty parameter, we establish local convergence of the ADMM scheme to a primal-dual solution, and a local linear convergence rate for the case where the constraint set is polyhedral convex. Finally, we present three analytic examples to illustrate the applicability of our local convergence result and the necessity of the local assumptions.
format Preprint
id arxiv_https___arxiv_org_abs_2603_20751
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Local Convergence Analysis of ADMM for Nonconvex Composite Optimization
Xie, Xiyuan
Yang, Lihua
li, Qia
Optimization and Control
90C26, 90C30, 65K05
In this paper, we study the local convergence of the standard ADMM scheme for a class of nonconvex composite problems arising from modern imaging and machine learning models. This problem is constrained by a closed convex set, while its objective is the sum of a continuously differentiable (possibly nonconvex) smooth term and a polyhedral convex nonsmooth term composed with a linear mapping. Our analysis is mainly motivated by the recent works of Rockafellar [29,30]. We begin with an elementary proof of a key local strong convexity property of the Moreau envelope of polyhedral convex functions. Building on this property, we show that the strong variational sufficiency condition holds for the considered problem under appropriate assumptions. Using the strong variational sufficiency condition, we further derive a descent inequality for the ADMM iterates, in a form analogous to the classical descent analysis of ADMM for convex problems. As a consequence, for a suitable choice of the penalty parameter, we establish local convergence of the ADMM scheme to a primal-dual solution, and a local linear convergence rate for the case where the constraint set is polyhedral convex. Finally, we present three analytic examples to illustrate the applicability of our local convergence result and the necessity of the local assumptions.
title Local Convergence Analysis of ADMM for Nonconvex Composite Optimization
topic Optimization and Control
90C26, 90C30, 65K05
url https://arxiv.org/abs/2603.20751