Imagen de Portada

Convergence of Clipped SGD on Convex $(L_0,L_1)$-Smooth Functions

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Gaash, Ofir, Levy, Kfir Yehuda, Carmon, Yair
Formato:	Preprint
Publicado:	2025
Materias:	Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Convergence of Clipped-SGD for Convex $(L_0,L_1)$-Smooth Optimization with Heavy-Tailed Noise
por: Chezhegov, Savelii, et al.
Publicado: (2025)

Safe Primal-Dual Optimization with a Single Smooth Constraint
por: Usmanova, Ilnura, et al.
Publicado: (2025)

SLowcal-SGD: Slow Query Points Improve Local-SGD for Stochastic Convex Optimization
por: Dahan, Tehila, et al.
Publicado: (2023)

Making SGD Parameter-Free
por: Carmon, Yair, et al.
Publicado: (2022)

Methods for Convex $(L_0,L_1)$-Smooth Optimization: Clipping, Acceleration, and Adaptivity
por: Gorbunov, Eduard, et al.
Publicado: (2024)

The Price of Adaptivity in Stochastic Convex Optimization
por: Carmon, Yair, et al.
Publicado: (2024)

Gradient-Variation Online Adaptivity for Accelerated Optimization with Hölder Smoothness
por: Zhao, Yuheng, et al.
Publicado: (2025)

Faster Stochastic Optimization with Arbitrary Delays via Asynchronous Mini-Batching
por: Attia, Amit, et al.
Publicado: (2024)

Avoiding Bias in Clipped SGD for Overparameterized Models under Generalized Smoothness
por: Lobanov, Aleksandr, et al.
Publicado: (2026)

$μ^2$-SGD: Stable Stochastic Optimization via a Double Momentum Mechanism
por: Dahan, Tehila, et al.
Publicado: (2023)

On the Convergence of DP-SGD with Adaptive Clipping
por: Shulgin, Egor, et al.
Publicado: (2024)

Differentially Private Clipped-SGD: High-Probability Convergence with Arbitrary Clipping Level
por: Khah, Saleh Vatan, et al.
Publicado: (2025)

Linear Convergence Rate in Convex Setup is Possible! Gradient Descent Method Variants under $(L_0,L_1)$-Smoothness
por: Lobanov, Aleksandr, et al.
Publicado: (2024)

Last-Iterate Complexity of SGD for Convex and Smooth Stochastic Problems
por: Garrigos, Guillaume, et al.
Publicado: (2025)

Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization
por: Armacki, Aleksandar, et al.
Publicado: (2026)

The Sample Complexity of Parameter-Free Stochastic Convex Optimization
por: Lawrence, Jared, et al.
Publicado: (2025)

Optimizing $(L_0, L_1)$-Smooth Functions by Gradient Methods
por: Vankov, Daniil, et al.
Publicado: (2024)

On Convergence of Incremental Gradient for Non-Convex Smooth Functions
por: Koloskova, Anastasia, et al.
Publicado: (2023)

Clipped Stochastic Gradient Tracking For Locally Smooth Functions
por: Mei, Leilei, et al.
Publicado: (2026)

Fast Last-Iterate Convergence of SGD in the Smooth Interpolation Regime
por: Attia, Amit, et al.
Publicado: (2025)

Near-Optimal Convergence of Accelerated Gradient Methods under Generalized and $(L_0, L_1)$-Smoothness
por: Tyurin, Alexander
Publicado: (2025)

Diagonalisation SGD: Fast & Convergent SGD for Non-Differentiable Models via Reparameterisation and Smoothing
por: Wagner, Dominik, et al.
Publicado: (2024)

From Gradient Clipping to Normalization for Heavy Tailed SGD
por: Hübler, Florian, et al.
Publicado: (2024)

Information Geometry of Exponentiated Gradient: Convergence beyond L-Smoothness
por: Elshiaty, Yara, et al.
Publicado: (2025)

The Optimal Smoothings of Sublinear Functions and Convex Cones
por: Samakhoana, Thabo, et al.
Publicado: (2025)

Clipped SGD Algorithms for Performative Prediction: Tight Bounds for Clipping Bias and Remedies
por: Li, Qiang, et al.
Publicado: (2024)

Median Clipping for Zeroth-order Non-Smooth Convex Optimization and Multi-Armed Bandit Problem with Heavy-tailed Symmetric Noise
por: Kornilov, Nikita, et al.
Publicado: (2024)

Locally Linear Convergence for Nonsmooth Convex Optimization via Coupled Smoothing and Momentum
por: Baghbadorani, Reza Rahimi, et al.
Publicado: (2025)

Last Iterate Convergence of AdaGrad-Norm for Convex Non-Smooth Optimization
por: Preobrazhenskaia, Margarita, et al.
Publicado: (2026)

Accelerated Parameter-Free Stochastic Optimization
por: Kreisler, Itai, et al.
Publicado: (2024)

Sign Operator for Coping with Heavy-Tailed Noise in Non-Convex Optimization: High Probability Bounds Under $(L_0, L_1)$-Smoothness
por: Kornilov, Nikita, et al.
Publicado: (2025)

Penalty-Based Smoothing of Convex Nonsmooth Supremum Functions with Accelerated Inertial Dynamics
por: Adly, Samir, et al.
Publicado: (2026)

Solving Convex Smooth Function Constrained Optimization Is Almost As Easy As Unconstrained Optimization
por: Zhang, Zhe, et al.
Publicado: (2022)

Extracting Dual Solutions via Primal Optimizers
por: Carmon, Yair, et al.
Publicado: (2024)

Non-Asymptotic Global Convergence of PPO-Clip
por: Liu, Yin, et al.
Publicado: (2025)

Convergence of the Iterates for Momentum and RMSProp for Local Smooth Functions: Adaptation is the Key
por: Bensaid, Bilel, et al.
Publicado: (2024)

Convergence and Inference of Stream SGD, with Applications to Queueing Systems and Inventory Control
por: Li, Xiang, et al.
Publicado: (2023)

Gamma-Convergence of Convex Functions, Conjugates, and Subdifferentials
por: Correa, Rafael, et al.
Publicado: (2025)

Muon Does Not Converge on Convex Lipschitz Functions
por: Parshakova, Tetiana, et al.
Publicado: (2026)

Adam-SHANG: A Convergent Adam-Type Method for Stochastic Smooth Convex Optimization
por: Yu, Yaxin, et al.
Publicado: (2026)