A Single-Loop Stochastic Gradient Algorithm for Minimax Optimization with Nonlinear Coupled Constraints
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914526143709184 |
|---|---|
| author | Cao, Qichao Zeng, Shangzhi Zhang, Jin Zhou, Yuxuan |
| author_facet | Cao, Qichao Zeng, Shangzhi Zhang, Jin Zhou, Yuxuan |
| contents | In this paper, we propose a single-loop stochastic gradient algorithm for solving stochastic nonconvex-concave minimax optimization with nonlinear convex coupled constraints (MCC). The proposed method, SPACO (Stochastic Penalty-based Algorithm for minimax optimization with COupled constraints), is built upon a penalty-based smooth approximation framework for MCC. This framework integrates a quadratic penalty scheme with regularization to yield a continuously differentiable approximation of the MCC problem. We provide theoretical convergence guarantees for this smoothing framework. Furthermore, we establish non-asymptotic complexity bounds and provide an asymptotic analysis characterizing the stationarity of accumulation points for the iterates generated by SPACO. Experimental results on synthetic examples and practical machine learning tasks demonstrate the effectiveness and efficiency of the proposed method. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_01246 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | A Single-Loop Stochastic Gradient Algorithm for Minimax Optimization with Nonlinear Coupled Constraints Cao, Qichao Zeng, Shangzhi Zhang, Jin Zhou, Yuxuan Optimization and Control In this paper, we propose a single-loop stochastic gradient algorithm for solving stochastic nonconvex-concave minimax optimization with nonlinear convex coupled constraints (MCC). The proposed method, SPACO (Stochastic Penalty-based Algorithm for minimax optimization with COupled constraints), is built upon a penalty-based smooth approximation framework for MCC. This framework integrates a quadratic penalty scheme with regularization to yield a continuously differentiable approximation of the MCC problem. We provide theoretical convergence guarantees for this smoothing framework. Furthermore, we establish non-asymptotic complexity bounds and provide an asymptotic analysis characterizing the stationarity of accumulation points for the iterates generated by SPACO. Experimental results on synthetic examples and practical machine learning tasks demonstrate the effectiveness and efficiency of the proposed method. |
| title | A Single-Loop Stochastic Gradient Algorithm for Minimax Optimization with Nonlinear Coupled Constraints |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2605.01246 |