Cover Image

Global Dynamics of Heavy-Tailed SGDs in Nonconvex Loss Landscape: Characterization and Control

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Xingyu, Rhee, Chang-Han
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Probability
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Large Deviations and Metastability Analysis for Heavy-Tailed Dynamical Systems
by: Wang, Xingyu, et al.
Published: (2023)

First-Exit Time Analysis for Truncated Heavy-Tailed Dynamical Systems
by: Wang, Xingyu, et al.
Published: (2026)

Implicit Compressibility of Overparametrized Neural Networks Trained with Heavy-Tailed SGD
by: Wan, Yijun, et al.
Published: (2023)

Strongly Efficient Rare-Event Simulation for Regularly Varying Lévy Processes with Infinite Activities
by: Wang, Xingyu, et al.
Published: (2023)

Diffusion Models with Heavy-Tailed Targets: Score Estimation and Sampling Guarantees
by: Yu, Yifeng, et al.
Published: (2026)

Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise
by: Agrawal, Shubhada, et al.
Published: (2026)

Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise
by: Dang, Thanh, et al.
Published: (2025)

On the Nonconvexity of Push-Forward Constraints and Its Consequences in Machine Learning
by: de Lara, Lucas, et al.
Published: (2024)

Steady-State Behavior of Constant-Stepsize Stochastic Approximation: Gaussian Approximation and Tail Bounds
by: Wang, Zedong, et al.
Published: (2026)

Tail Asymptotics of Cluster Sizes in Multivariate Heavy-Tailed Hawkes Processes
by: Blanchet, Jose, et al.
Published: (2025)

Stability and Generalization of Nonconvex Optimization with Heavy-Tailed Noise
by: Chen, Hongxu, et al.
Published: (2026)

Sharper Perturbed-Kullback-Leibler Exponential Tail Bounds for Beta and Dirichlet Distributions
by: Perrault, Pierre
Published: (2025)

Variational Tail Bounds for Norms of Random Vectors and Matrices
by: Bahmani, Sohail
Published: (2025)

Near-Optimal Decentralized Stochastic Nonconvex Optimization with Heavy-Tailed Noise
by: Wang, Menglian, et al.
Published: (2026)

Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning
by: Chemnitz, Dennis, et al.
Published: (2024)

Sharp Concentration Inequalities: Phase Transition and Mixing of Orlicz Tails with Variance
by: Shen, Yinan, et al.
Published: (2026)

Sample Path Large Deviations for Multivariate Heavy-Tailed Hawkes Processes and Related Lévy Processes
by: Blanchet, Jose, et al.
Published: (2025)

A Method For Bounding Tail Probabilities
by: Zlatanov, Nikola
Published: (2024)

Variational Smoothing and Inference for SDEs from Sparse Data with Dynamic Neural Flows
by: Wang, Yu, et al.
Published: (2026)

Resolving Node Identifiability in Graph Neural Processes via Laplacian Spectral Encodings
by: Yan, Zimo, et al.
Published: (2025)

Optimal Asynchronous Stochastic Nonconvex Optimization under Heavy-Tailed Noise
by: Wu, Yidong, et al.
Published: (2026)

EVT-Based Rate-Preserving Distributional Robustness for Tail Risk Functionals
by: Deo, Anand
Published: (2025)

Properties of Discrete Sliced Wasserstein Losses
by: Tanguy, Eloi, et al.
Published: (2023)

A General Reduction for High-Probability Analysis with General Light-Tailed Distributions
by: Attia, Amit, et al.
Published: (2024)

Tail-Aware Information-Theoretic Generalization for RLHF and SGLD
by: Zhang, Huiming, et al.
Published: (2026)

A Note on Asynchronous Challenges: Unveiling Formulaic Bias and Data Loss in the Hayashi-Yoshida Estimator
by: Georgiadis, Evangelos
Published: (2024)

Convergence Error Analysis of Reflected Gradient Langevin Dynamics for Globally Optimizing Non-Convex Constrained Problems
by: Sato, Kanji, et al.
Published: (2022)

Decentralized Proximal Stochastic Gradient Langevin Dynamics
by: Islam, Mohammad Rafiqul, et al.
Published: (2026)

Convergence of SGD for Training Neural Networks with Sliced Wasserstein Losses
by: Tanguy, Eloi
Published: (2023)

Birth-death dynamics for sampling: Global convergence, approximations and their asymptotics
by: Lu, Yulong, et al.
Published: (2022)

Static and Dynamic Approaches to Computing Barycenters of Probability Measures on Graphs
by: Gentile, David, et al.
Published: (2026)

A Gaussian Comparison Theorem for Training Dynamics in Machine Learning
by: Panahi, Ashkan
Published: (2026)

Tail Asymptotic of Heavy-Tail Risks with Elliptical Copula
by: Wang, Kai, et al.
Published: (2024)

Tail-Sensitive KL and Rényi Convergence of Unadjusted Hamiltonian Monte Carlo via One-Shot Couplings
by: Bou-Rabee, Nawaf, et al.
Published: (2026)

Convergence, Sticking and Escape: Stochastic Dynamics Near Critical Points in SGD
by: Dudukalov, Dmitry, et al.
Published: (2025)

Homogenization of Multi-agent Learning Dynamics in Finite-state Markov Games
by: Kerzreho, Yann
Published: (2025)

Denoising distances beyond the volumetric barrier
by: Huang, Han, et al.
Published: (2026)

Reconstructing the Geometry of Random Geometric Graphs
by: Huang, Han, et al.
Published: (2024)

Large Deviation Upper Bounds and Improved MSE Rates of Nonlinear SGD: Heavy-tailed Noise and Power of Symmetry
by: Armacki, Aleksandar, et al.
Published: (2024)

ResNets of All Shapes and Sizes: Convergence of Training Dynamics in the Large-scale Limit
by: Chaintron, Louis-Pierre, et al.
Published: (2026)