Image de couverture de livre

Dissipative Gradient Descent Ascent Method: A Control Theory Inspired Algorithm for Min-max Optimization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zheng, Tianqi, Loizou, Nicolas, You, Pengcheng, Mallada, Enrique
Format:	Preprint
Publié:	2024
Sujets:	Optimization and Control Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems
par: Zhang, Jiawei, et autres
Publié: (2020)

Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization
par: Lin, Tianyi, et autres
Publié: (2024)

A Local Polyak-Lojasiewicz and Descent Lemma of Gradient Descent For Overparametrized Linear Models
par: Xu, Ziqing, et autres
Publié: (2025)

Mirror Descent-Ascent for mean-field min-max problems
par: Lascu, Razvan-Andrei, et autres
Publié: (2024)

Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates
par: Zhang, Siqi, et autres
Publié: (2023)

On Gradient Descent Ascent for Nonconvex-Concave Minimax Problems
par: Lin, Tianyi, et autres
Publié: (2019)

Stochastic Smoothed Gradient Descent Ascent for Federated Minimax Optimization
par: Shen, Wei, et autres
Publié: (2023)

Safeguarded Stochastic Polyak Step Sizes for Non-smooth Optimization: Robust Performance Without Small (Sub)Gradients
par: Oikonomou, Dimitris, et autres
Publié: (2025)

The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization
par: Daskalakis, Constantinos, et autres
Publié: (2018)

A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimax Optimization
par: Zhu, Yuchen, et autres
Publié: (2024)

Decentralized Stochastic Gradient Descent Ascent for Finite-Sum Minimax Problems
par: Gao, Hongchang
Publié: (2022)

A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization
par: Lu, Songtao
Publié: (2022)

Adaptive Sharpness-Aware Minimization with a Polyak-type Step size: A Theory-Grounded Scheduler
par: Oikonomou, Dimitris, et autres
Publié: (2026)

Negative Stepsizes Make Gradient-Descent-Ascent Converge
par: Shugart, Henry, et autres
Publié: (2025)

Extragradient Method for $(L_0, L_1)$-Lipschitz Root-finding Problems
par: Choudhury, Sayantan, et autres
Publié: (2025)

A Unified Analysis of Saddle Flow Dynamics: Stability and Algorithm Design
par: You, Pengcheng, et autres
Publié: (2024)

Sobolev Gradient Ascent for Optimal Transport: Barycenter Optimization and Convergence Analysis
par: Kim, Kaheon, et autres
Publié: (2025)

Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance
par: Oikonomou, Dimitris, et autres
Publié: (2024)

Sharpness-Aware Minimization: General Analysis and Improved Rates
par: Oikonomou, Dimitris, et autres
Publié: (2025)

Dual Optimistic Ascent (PI Control) is the Augmented Lagrangian Method in Disguise
par: Ramirez, Juan, et autres
Publié: (2025)

Symplectic Inductive Bias for Data-Driven Target Reachability in Hamiltonian Systems
par: Ouyang, Zhuo, et autres
Publié: (2026)

On Penalty-based Bilevel Gradient Descent Method
par: Shen, Han, et autres
Publié: (2023)

Enhancing Fractional Gradient Descent with Learned Optimizers
par: Sobotka, Jan, et autres
Publié: (2025)

On the Convergence of Proximal Algorithms for Weakly-convex Min-max Optimization
par: Tapia-Riera, Guido, et autres
Publié: (2026)

The Sample Complexity of Gradient Descent in Stochastic Convex Optimization
par: Livni, Roi
Publié: (2024)

Quadratic Gradient: A Unified Framework Bridging Gradient Descent and Newton-Type Methods by Synthesizing Hessians and Gradients
par: Chiang, John
Publié: (2022)

Stochastic Adaptive Gradient Descent Without Descent
par: Aujol, Jean-François, et autres
Publié: (2025)

Corner Gradient Descent
par: Yarotsky, Dmitry
Publié: (2025)

Boosting Gradient Ascent for Continuous DR-submodular Maximization
par: Zhang, Qixin, et autres
Publié: (2024)

Locally Adaptive Federated Learning
par: Mukherjee, Sohom, et autres
Publié: (2023)

Multiplayer Federated Learning: Reaching Equilibrium with Less Communication
par: Yoon, TaeHo, et autres
Publié: (2025)

GeoAdaLer: Geometric Insights into Adaptive Stochastic Gradient Descent Algorithms
par: Eleh, Chinedu, et autres
Publié: (2024)

Adaptive Conditional Gradient Descent
par: Khademi, Abbas, et autres
Publié: (2025)

$k$-SVD with Gradient Descent
par: Jedra, Yassir, et autres
Publié: (2025)

DoWG Unleashed: An Efficient Universal Parameter-Free Gradient Descent Method
par: Khaled, Ahmed, et autres
Publié: (2023)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
par: Lu, Eric
Publié: (2025)

Anytime Acceleration of Gradient Descent
par: Zhang, Zihan, et autres
Publié: (2024)

Rapid Overfitting of Multi-Pass Stochastic Gradient Descent in Stochastic Convex Optimization
par: Vansover-Hager, Shira, et autres
Publié: (2025)

Super Gradient Descent: Global Optimization requires Global Gradient
par: Achour, Seifeddine
Publié: (2024)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)