Cover Image

Dual Averaging Converges for Nonconvex Smooth Stochastic Optimization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Tuo, Saad, El Mehdi, Kotłowski, Wojciech, Orabona, Francesco
Format:	Preprint
Published:	2025
Subjects:	Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

New Lower Bounds for Stochastic Non-Convex Optimization through Divergence Decomposition
by: Saad, El Mehdi, et al.
Published: (2025)

Stochastic Smoothed Primal-Dual Algorithms for Nonconvex Optimization with Linear Inequality Constraints
by: Huang, Ruichuan, et al.
Published: (2025)

ATA: Adaptive Task Allocation for Efficient Resource Management in Distributed Machine Learning
by: Maranjyan, Artavazd, et al.
Published: (2025)

Trust Region Methods For Nonconvex Stochastic Optimization Beyond Lipschitz Smoothness
by: Xie, Chenghan, et al.
Published: (2023)

Decentralized Stochastic Nonconvex Optimization under the Relaxed Smoothness
by: Luo, Luo, et al.
Published: (2025)

Optimal Stochastic Non-smooth Non-convex Optimization through Online-to-Non-convex Conversion
by: Cutkosky, Ashok, et al.
Published: (2023)

Noisy Pairwise-Comparison Random Search for Smooth Nonconvex Optimization
by: Bakkali, Taha El, et al.
Published: (2026)

A Modern Introduction to Online Learning
by: Orabona, Francesco
Published: (2019)

A Note on How to Remove the $\ln\ln T$ Term from the Squint Bound
by: Orabona, Francesco
Published: (2026)

Distributed Nonconvex Optimization with Double Privacy Protection and Exact Convergence
by: Ou, Zichong, et al.
Published: (2025)

Convergence Analysis of Stochastic Accelerated Gradient Methods for Generalized Smooth Optimizations
by: Yu, Chenhao, et al.
Published: (2025)

Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
by: Liu, Zijian, et al.
Published: (2024)

A Smoothing Consensus-Based Optimization Algorithm for Nonsmooth Nonconvex Optimization
by: Wei, Jiazhen, et al.
Published: (2025)

Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization
by: Sato, Naoki, et al.
Published: (2023)

Stochastic Push-Pull for Decentralized Nonconvex Optimization
by: You, Runze, et al.
Published: (2025)

On the Complexity of Decentralized Smooth Nonconvex Finite-Sum Optimization
by: Luo, Luo, et al.
Published: (2022)

Constrained Stochastic Spectral Preconditioning Converges for Nonconvex Objectives
by: Oikonomidis, Konstantinos, et al.
Published: (2026)

Convergence of Decentralized Stochastic Subgradient-based Methods for Nonsmooth Nonconvex functions
by: Zhang, Siyuan, et al.
Published: (2024)

An Equivalence Between Static and Dynamic Regret Minimization
by: Jacobsen, Andrew, et al.
Published: (2024)

Nonsmooth Nonconvex-Concave Minimax Optimization: Convergence Criteria and Algorithms
by: Shi, Jinyang, et al.
Published: (2026)

Stochastic Optimization Schemes for Performative Prediction with Nonconvex Loss
by: Li, Qiang, et al.
Published: (2024)

Compressed Distributed Stochastic Nonconvex Optimization with Differential Privacy
by: Xie, Antai, et al.
Published: (2026)

Learning-rate-free Momentum SGD with Reshuffling Converges in Nonsmooth Nonconvex Optimization
by: Hu, Xiaoyin, et al.
Published: (2024)

Improved Convergence Rates of Muon Optimizer for Nonconvex Optimization
by: Nagashima, Shuntaro, et al.
Published: (2026)

Generalized Smooth Stochastic Variational Inequalities: Almost Sure Convergence and Convergence Rates
by: Vankov, Daniil, et al.
Published: (2024)

Revisiting Randomized Smoothing: Nonsmooth Nonconvex Optimization Beyond Global Lipschitz Continuity
by: Xia, Jingfan, et al.
Published: (2025)

Smoothing Meets Perturbation: Unified and Tight Analysis for Nonconvex-Concave Minimax Optimization
by: Li, Jiajin, et al.
Published: (2026)

On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization
by: Zhou, Dongruo, et al.
Published: (2018)

INTHOP: A Second-Order Globally Convergent Method for Nonconvex Optimization
by: Kumar, Krishan, et al.
Published: (2025)

Compressed Zeroth-Order Algorithm for Stochastic Distributed Nonconvex Optimization
by: Wang, Haonan, et al.
Published: (2025)

Heterogeneous Stochastic Momentum ADMM for Distributed Nonconvex Composite Optimization
by: Zhang, Yangming, et al.
Published: (2026)

Stochastic Bregman Subgradient Methods for Nonsmooth Nonconvex Optimization Problems
by: Ding, Kuangyu, et al.
Published: (2024)

Smoothing Iterative Consensus-based Optimization Algorithm for Nonsmooth Nonconvex Optimization Problems with Global Optimality
by: Wei, Jiazhen, et al.
Published: (2025)

Smoothing-Enabled Randomized Stochastic Gradient Schemes for Solving Nonconvex Nonsmooth Potential Games under Uncertainty
by: Xiao, Zhuoyu
Published: (2026)

New Perspectives on the Polyak Stepsize: Surrogate Functions and Negative Results
by: Orabona, Francesco, et al.
Published: (2025)

A Best-of-Both-Worlds Proof for Tsallis-INF without Fenchel Conjugates
by: Lee, Wei-Cheng, et al.
Published: (2025)

A Finite-Time Analysis of TD Learning with Linear Function Approximation without Projections or Strong Convexity
by: Lee, Wei-Cheng, et al.
Published: (2025)

A Momentum-based Stochastic Algorithm for Linearly Constrained Nonconvex Optimization
by: Qiu, Chenyang, et al.
Published: (2026)

Distributed Nonconvex Optimization with Exponential Convergence Rate via Hybrid Systems Methods
by: Hendrickson, Katherine R., et al.
Published: (2025)

Inexact Zeroth-Order Nonsmooth and Nonconvex Stochastic Composite Optimization and Applications
by: Pougkakiotis, Spyridon, et al.
Published: (2025)