Copertina

Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Cai, Haoyuan, Alghunaim, Sulaiman A., Sayed, Ali H.
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Diffusion Stochastic Optimization for Min-Max Problems
di: Cai, Haoyuan, et al.
Pubblicazione: (2024)

DAMA: A Unified Accelerated Approach for Decentralized Nonconvex Minimax Optimization-Part I: Algorithm Development and Results
di: Cai, Haoyuan, et al.
Pubblicazione: (2025)

DAMA: A Unified Accelerated Approach for Decentralized Nonconvex Minimax Optimization-Part II: Convergence and Performance Analyses
di: Cai, Haoyuan, et al.
Pubblicazione: (2025)

Achieving Linear Speedup with ProxSkip in Distributed Stochastic Optimization
di: Guo, Luyao, et al.
Pubblicazione: (2023)

High-Probability Convergence in Decentralized Stochastic Optimization with Gradient Tracking
di: Armacki, Aleksandar, et al.
Pubblicazione: (2026)

Diffusion Stochastic Learning Over Adaptive Competing Networks
di: Zhao, Yike, et al.
Pubblicazione: (2025)

Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone Inclusion
di: Cai, Yang, et al.
Pubblicazione: (2022)

The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization
di: Daskalakis, Constantinos, et al.
Pubblicazione: (2018)

Scalable Min-Max Optimization via Primal-Dual Exact Pareto Optimization
di: Park, Sangwoo, et al.
Pubblicazione: (2025)

Revisiting Inexact Fixed-Point Iterations for Min-Max Problems: Stochasticity and Structured Nonconvexity
di: Alacaoglu, Ahmet, et al.
Pubblicazione: (2024)

Online Min-Max Optimization: From Individual Regrets to Cumulative Saddle Points
di: Vyas, Abhijeet, et al.
Pubblicazione: (2026)

(Accelerated) Noise-adaptive Stochastic Heavy-Ball Momentum
di: Dang, Anh, et al.
Pubblicazione: (2024)

Stochastic Difference-of-Convex Optimization with Momentum
di: Chayti, El Mahdi, et al.
Pubblicazione: (2025)

Implicit Riemannian Optimism with Applications to Min-Max Problems
di: Roux, Christophe, et al.
Pubblicazione: (2025)

A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration
di: Hu, Yuchen, et al.
Pubblicazione: (2025)

Non-convex Stochastic Composite Optimization with Polyak Momentum
di: Gao, Yuan, et al.
Pubblicazione: (2024)

On the Provable Suboptimality of Momentum SGD in Nonstationary Stochastic Optimization
di: Sahu, Sharan, et al.
Pubblicazione: (2026)

On the Convergence of Min-Max Langevin Dynamics and Algorithm
di: Cai, Yang, et al.
Pubblicazione: (2024)

Min-Max Optimization Is Strictly Easier Than Variational Inequalities
di: Shugart, Henry, et al.
Pubblicazione: (2025)

Stochastic Compositional Optimization via Hybrid Momentum Frank--Wolfe
di: Chayti, El Mahdi
Pubblicazione: (2026)

Compressed Decentralized Momentum Stochastic Gradient Methods for Nonconvex Optimization
di: Liu, Wei, et al.
Pubblicazione: (2025)

A Gauss-Newton Approach for Min-Max Optimization in Generative Adversarial Networks
di: Mishra, Neel, et al.
Pubblicazione: (2024)

Second-Order Min-Max Optimization with Lazy Hessians
di: Chen, Lesi, et al.
Pubblicazione: (2024)

Understanding Outer Optimizers in Local SGD: Learning Rates, Momentum, and Acceleration
di: Khaled, Ahmed, et al.
Pubblicazione: (2025)

Accelerated Parameter-Free Stochastic Optimization
di: Kreisler, Itai, et al.
Pubblicazione: (2024)

On the Stability Connection Between Discrete-Time Algorithms and Their Resolution ODEs: Applications to Min-Max Optimisation
di: Farzin, Amir Ali, et al.
Pubblicazione: (2026)

FedMuon: Federated Learning with Bias-corrected LMO-based Optimization
di: Takezawa, Yuki, et al.
Pubblicazione: (2025)

Improving Stochastic Cubic Newton with Momentum
di: Chayti, El Mahdi, et al.
Pubblicazione: (2024)

Stability and Generalization for Stochastic Recursive Momentum-based Algorithms for (Strongly-)Convex One to $K$-Level Stochastic Optimizations
di: Pan, Xiaokang, et al.
Pubblicazione: (2024)

Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent
di: Sato, Naoki, et al.
Pubblicazione: (2024)

$μ^2$-SGD: Stable Stochastic Optimization via a Double Momentum Mechanism
di: Dahan, Tehila, et al.
Pubblicazione: (2023)

A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems
di: Zhang, Jiawei, et al.
Pubblicazione: (2020)

Equity-Transformer: Solving NP-hard Min-Max Routing Problems as Sequential Generation with Equity Context
di: Son, Jiwoo, et al.
Pubblicazione: (2023)

Neighbor-Sampling Based Momentum Stochastic Methods for Training Graph Neural Networks
di: Noel, Molly, et al.
Pubblicazione: (2025)

Shuffling Momentum Gradient Algorithm for Convex Optimization
di: Tran, Trang H., et al.
Pubblicazione: (2024)

A least-square method for non-asymptotic identification in linear switching control
di: Sun, Haoyuan, et al.
Pubblicazione: (2024)

Online Learning for Supervisory Switching Control
di: Sun, Haoyuan, et al.
Pubblicazione: (2026)

Dynamics of Stochastic Momentum with Sparse Updates in High Dimensions
di: Everett, Katie, et al.
Pubblicazione: (2026)

Last-Iterate Convergence: Zero-Sum Games and Constrained Min-Max Optimization
di: Daskalakis, Constantinos, et al.
Pubblicazione: (2018)

SGD with Adaptive Preconditioning: Unified Analysis and Momentum Acceleration
di: Kovalev, Dmitry
Pubblicazione: (2025)