An Adaptive Proximal ADMM for Nonconvex Linearly Constrained Composite Programs

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Maia, Leandro Farias, Gutman, David H., Monteiro, Renato D. C., Silva, Gilson N.
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909005331300352
author Maia, Leandro Farias
Gutman, David H.
Monteiro, Renato D. C.
Silva, Gilson N.
author_facet Maia, Leandro Farias
Gutman, David H.
Monteiro, Renato D. C.
Silva, Gilson N.
contents This paper develops an adaptive proximal alternating direction method of multipliers (ADMM) for solving linearly constrained, composite optimization problems under the assumption that the smooth component of the objective is weakly convex, while the non-smooth component is convex and block-separable. The proposed method is adaptive to all problem parameters, including smoothness and weak convexity constants, and allows each of its block proximal subproblems to be inexactly solved. Each iteration of our adaptive proximal ADMM consists of two steps: the sequential solution of each block proximal subproblem; and adaptive tests to decide whether to perform a full Lagrange multiplier and/or penalty parameter update(s). Without any rank assumptions on the constraint matrices, it is shown that the adaptive proximal ADMM obtains an approximate first-order stationary point of the constrained problem in a number of iterations that matches the state-of-the-art complexity for the class of proximal ADMM's. The three proof-of-concept numerical experiments that conclude the paper suggest our adaptive proximal ADMM enjoys significant computational benefits.
format Preprint
id arxiv_https___arxiv_org_abs_2407_09927
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle An Adaptive Proximal ADMM for Nonconvex Linearly Constrained Composite Programs
Maia, Leandro Farias
Gutman, David H.
Monteiro, Renato D. C.
Silva, Gilson N.
Optimization and Control
This paper develops an adaptive proximal alternating direction method of multipliers (ADMM) for solving linearly constrained, composite optimization problems under the assumption that the smooth component of the objective is weakly convex, while the non-smooth component is convex and block-separable. The proposed method is adaptive to all problem parameters, including smoothness and weak convexity constants, and allows each of its block proximal subproblems to be inexactly solved. Each iteration of our adaptive proximal ADMM consists of two steps: the sequential solution of each block proximal subproblem; and adaptive tests to decide whether to perform a full Lagrange multiplier and/or penalty parameter update(s). Without any rank assumptions on the constraint matrices, it is shown that the adaptive proximal ADMM obtains an approximate first-order stationary point of the constrained problem in a number of iterations that matches the state-of-the-art complexity for the class of proximal ADMM's. The three proof-of-concept numerical experiments that conclude the paper suggest our adaptive proximal ADMM enjoys significant computational benefits.
title An Adaptive Proximal ADMM for Nonconvex Linearly Constrained Composite Programs
topic Optimization and Control
url https://arxiv.org/abs/2407.09927