Cover Image

Large Deviation Upper Bounds and Improved MSE Rates of Nonlinear SGD: Heavy-tailed Noise and Power of Symmetry

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Armacki, Aleksandar, Yu, Shuhua, Bajovic, Dragana, Jakovetic, Dusan, Kar, Soummya
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Optimization and Control Probability
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Sharp High-Probability Rates for Nonlinear SGD under Heavy-Tailed Noise via Symmetrization
by: Armacki, Aleksandar, et al.
Published: (2025)

High-probability Convergence Bounds for Nonlinear Stochastic Gradient Descent Under Heavy-tailed Noise
by: Armacki, Aleksandar, et al.
Published: (2023)

Nonlinear Stochastic Gradient Descent and Heavy-tailed Noise: A Unified Framework and High-probability Guarantees
by: Armacki, Aleksandar, et al.
Published: (2024)

Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization
by: Armacki, Aleksandar, et al.
Published: (2026)

A Unified Framework for Center-based Clustering of Distributed Data
by: Armacki, Aleksandar, et al.
Published: (2024)

Distributed gradient methods under heavy-tailed communication noise
by: Vukovic, Manojlo, et al.
Published: (2025)

Tackling heavy-tailed noise in distributed estimation: Asymptotic performance and tradeoffs
by: Bajovic, Dragana, et al.
Published: (2026)

Decentralized Nonconvex Optimization under Heavy-Tailed Noise: Normalization and Optimal Convergence
by: Yu, Shuhua, et al.
Published: (2025)

Smoothed Gradient Clipping and Error Feedback for Decentralized Optimization under Symmetric Heavy-Tailed Noise
by: Yu, Shuhua, et al.
Published: (2023)

Distributed Gradient Clustering: Convergence and the Effect of Initialization
by: Armacki, Aleksandar, et al.
Published: (2026)

High-Probability Convergence Guarantees of Decentralized SGD
by: Armacki, Aleksandar, et al.
Published: (2025)

Robust stochastic first order methods in heavy-tailed noise via medoid mini-batch gradient sampling
by: Vukovic, Manojlo, et al.
Published: (2026)

Parallel Inexact Levenberg-Marquardt Method for Nearly-Separable Nonlinear Least Squares
by: Fodor, Lidija, et al.
Published: (2023)

Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise
by: Agrawal, Shubhada, et al.
Published: (2026)

Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise
by: Dang, Thanh, et al.
Published: (2025)

Convergence of SGD for Training Neural Networks with Sliced Wasserstein Losses
by: Tanguy, Eloi
Published: (2023)

Distributed Inexact Newton Method with Adaptive Step Sizes
by: Jakovetic, Dusan, et al.
Published: (2023)

Distribution-free expectation operators for robust pricing and stocking with heavy-tailed demand
by: Kleer, Pieter, et al.
Published: (2024)

Sharp Rates of MMD Empirical Estimation with Power Kernels
by: Colasanto, Francesco, et al.
Published: (2026)

Service Rate Control in Queues with Abandonments
by: Wu, Runhua, et al.
Published: (2025)

Can SGD Handle Heavy-Tailed Noise?
by: Fatkhullin, Ilyas, et al.
Published: (2025)

Enhancing Exploration in Global Optimization by Noise Injection in the Probability Measures Space
by: Serré, Gaëtan, et al.
Published: (2026)

Almost Sure Convergence of Stochastic Approximation: An Interplay of Noise and Step Size
by: Nguyen, Quang Dinh Thien, et al.
Published: (2026)

High-Probability Bounds for SGD under the Polyak-Lojasiewicz Condition with Markovian Noise
by: Kar, Avik, et al.
Published: (2026)

Optimal Control of the Nonlinear Stochastic Fokker--Planck Equation
by: Hambly, Ben, et al.
Published: (2024)

Mean Field Control with Poissonian Common Noise: A Pathwise Compactification Approach
by: Bo, Lijun, et al.
Published: (2025)

Sparsity of Quadratically Regularized Optimal Transport: Bounds on concentration and bias
by: Wiesel, Johannes, et al.
Published: (2024)

Bounding Escape Rates and Approximating Quasi-Stationary Distributions of Brownian Dynamics
by: Bramburger, Jason J.
Published: (2025)

Bayesian Inferential Motion Planning Using Heavy-Tailed Distributions
by: Vaziri, Ali, et al.
Published: (2025)

Second Order Fully Nonlinear Mean Field Games with Degenerate Diffusions
by: Bensoussan, Alain, et al.
Published: (2025)

Bounding the Difference between the Values of Robust and Non-Robust Markov Decision Problems
by: Neufeld, Ariel, et al.
Published: (2023)

Statistical Inference for Linear Functionals of Online SGD in High-dimensional Linear Regression
by: Agrawalla, Bhavya, et al.
Published: (2023)

One-Dimensional McKean-Vlasov Stochastic Variational Inequalities and Coupled BSDEs with Locally Holder Noise Coefficients
by: Ning, Ning, et al.
Published: (2023)

High-Probability Convergence in Decentralized Stochastic Optimization with Gradient Tracking
by: Armacki, Aleksandar, et al.
Published: (2026)

High-dimensional scaling limits and fluctuations of online least-squares SGD with smooth covariance
by: Balasubramanian, Krishnakumar, et al.
Published: (2023)

A Piecewise Lyapunov Analysis of Sub-quadratic SGD: Applications to Robust and Quantile Regression
by: Zhang, Yixuan, et al.
Published: (2025)

Linear Algebraic Truncation Algorithm with A Posteriori Error Bounds for Computing Markov Chain Equilibrium Gradients
by: Mahdian, Saied, et al.
Published: (2025)

Deciding Bank Interest Rates -- A Major-Minor Impulse Control Mean-Field Game Perspective
by: Chen, Fan, et al.
Published: (2024)

Large Deviations for Empirical Measures of Self-Interacting Markov Chains
by: Budhiraja, Amarjit, et al.
Published: (2023)

The Variational Approach in Filtering and Correlated Noise
by: Srinivasan, Sharan, et al.
Published: (2026)