The Augmented Lagrangian Methods: Overview and Recent Advances
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909856641843200 |
|---|---|
| author | Deng, Kangkang Wang, Rui Zhu, Zhenyuan Zhang, Junyu Wen, Zaiwen |
| author_facet | Deng, Kangkang Wang, Rui Zhu, Zhenyuan Zhang, Junyu Wen, Zaiwen |
| contents | Large-scale constrained optimization is pivotal in modern scientific, engineering, and industrial computation, often involving complex systems with numerous variables and constraints. This paper provides a unified and comprehensive perspective on constructing augmented Lagrangian functions (based on Hestenes-Powell-Rockafellar augmented Lagrangian) for various optimization problems, including nonlinear programming and convex and nonconvex composite programming. We present the augmented Lagrangian method (ALM), covering its theoretical foundations in both convex and nonconvex cases, and discuss several successful examples and applications. Recent advancements have extended ALM's capabilities to handle nonconvex constraints and ensure global convergence to first and second-order stationary points. For nonsmooth convex problems, ALM utilizes proximal operations, preserving desirable properties such as locally linear convergence rates. Furthermore, recent progress has refined the complexity analysis for ALM and tackled challenging integer programming instances. This review aims to offer a thorough understanding of ALM's benefits and limitations, exploring different ALM variants designed to enhance convergence and computational performance. We also illustrate effective algorithms for ALM subproblems across different types of optimization problems and highlight practical implementations in several fields. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_16827 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The Augmented Lagrangian Methods: Overview and Recent Advances Deng, Kangkang Wang, Rui Zhu, Zhenyuan Zhang, Junyu Wen, Zaiwen Optimization and Control 65K05, 90C30 Large-scale constrained optimization is pivotal in modern scientific, engineering, and industrial computation, often involving complex systems with numerous variables and constraints. This paper provides a unified and comprehensive perspective on constructing augmented Lagrangian functions (based on Hestenes-Powell-Rockafellar augmented Lagrangian) for various optimization problems, including nonlinear programming and convex and nonconvex composite programming. We present the augmented Lagrangian method (ALM), covering its theoretical foundations in both convex and nonconvex cases, and discuss several successful examples and applications. Recent advancements have extended ALM's capabilities to handle nonconvex constraints and ensure global convergence to first and second-order stationary points. For nonsmooth convex problems, ALM utilizes proximal operations, preserving desirable properties such as locally linear convergence rates. Furthermore, recent progress has refined the complexity analysis for ALM and tackled challenging integer programming instances. This review aims to offer a thorough understanding of ALM's benefits and limitations, exploring different ALM variants designed to enhance convergence and computational performance. We also illustrate effective algorithms for ALM subproblems across different types of optimization problems and highlight practical implementations in several fields. |
| title | The Augmented Lagrangian Methods: Overview and Recent Advances |
| topic | Optimization and Control 65K05, 90C30 |
| url | https://arxiv.org/abs/2510.16827 |