Cover Image

Limit Theorems for Stochastic Gradient Descent with Infinite Variance

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Blanchet, Jose, Mijatović, Aleksandar, Yang, Wenhao
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Probability
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks
by: Rangriz, Parsa
Published: (2025)

Central Limit Theorem for ergodic averages of Markov chains \& the comparison of sampling algorithms for heavy-tailed distributions
by: Brešar, Miha, et al.
Published: (2025)

Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent
by: Schertzer, Adrien, et al.
Published: (2024)

Non-asymptotic bounds for forward processes in denoising diffusions: Ornstein-Uhlenbeck is hard to beat
by: Brešar, Miha, et al.
Published: (2024)

Towards Continuous-Time Approximations for Stochastic Gradient Descent without Replacement
by: Perko, Stefan
Published: (2025)

Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning
by: Chemnitz, Dennis, et al.
Published: (2024)

Controlling the Flow: Stability and Convergence for Stochastic Gradient Descent with Decaying Regularization
by: Kassing, Sebastian, et al.
Published: (2025)

Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise
by: Dang, Thanh, et al.
Published: (2025)

Exact Dynamics of Multi-class Stochastic Gradient Descent
by: Collins-Woodfin, Elizabeth, et al.
Published: (2025)

Partially Stochastic Infinitely Deep Bayesian Neural Networks
by: Calvo-Ordonez, Sergio, et al.
Published: (2024)

Decoupled Functional Central Limit Theorems for Two-Time-Scale Stochastic Approximation
by: Han, Yuze, et al.
Published: (2024)

Type-II Saddles and Probabilistic Stability of Stochastic Gradient Descent
by: Ziyin, Liu, et al.
Published: (2023)

Deep Learning for Computing Convergence Rates of Markov Chains
by: Qu, Yanlin, et al.
Published: (2024)

Deep Learning for Markov Chains: Lyapunov Functions, Poisson's Equation, and Stationary Distributions
by: Qu, Yanlin, et al.
Published: (2025)

Dichotomy of Feature Learning and Unlearning: Fast-Slow Analysis on Neural Networks with Stochastic Gradient Descent
by: Imai, Shota, et al.
Published: (2026)

Functional Central Limit Theorem for Stochastic Gradient Descent
by: Flamand, Kessang, et al.
Published: (2026)

Central Limit Theorems for Stochastic Gradient Descent Quantile Estimators
by: Wei, Ziyang, et al.
Published: (2025)

Stochastic Gradient Descent Revisited
by: Louzi, Azar
Published: (2024)

Decentralized Proximal Stochastic Gradient Langevin Dynamics
by: Islam, Mohammad Rafiqul, et al.
Published: (2026)

Markov Chain Variance Estimation: A Stochastic Approximation Approach
by: Agrawal, Shubhada, et al.
Published: (2024)

A General-Purpose Theorem for High-Probability Bounds of Stochastic Approximation with Polyak Averaging
by: Khodadadian, Sajad, et al.
Published: (2025)

Improved Finite-Particle Convergence Rates for Stein Variational Gradient Descent
by: Banerjee, Sayan, et al.
Published: (2024)

Wasserstein-p Central Limit Theorem Rates: From Local Dependence to Markov Chains
by: Zhang, Yixuan, et al.
Published: (2026)

Stochastic Scaling Limits and Synchronization by Noise in Deep Transformer Models
by: Agazzi, Andrea, et al.
Published: (2026)

Exact Gradients for Stochastic Spiking Neural Networks Driven by Rough Signals
by: Holberg, Christian, et al.
Published: (2024)

Flatness-Aware Stochastic Gradient Langevin Dynamics
by: Bruno, Stefano, et al.
Published: (2025)

Central Limit Theorem for Bayesian Neural Network trained with Variational Inference
by: Descours, Arnaud, et al.
Published: (2024)

Detecting Stochasticity in Discrete Signals via Nonparametric Excursion Theorem
by: Tanweer, Sunia, et al.
Published: (2026)

Parameter Estimation in Stochastic Differential Equations via Wiener Chaos Expansion and Stochastic Gradient Descent
by: Delgado-Vences, Francisco, et al.
Published: (2026)

Gaussian Approximation and Multiplier Bootstrap for Stochastic Gradient Descent
by: Sheshukova, Marina, et al.
Published: (2025)

Stochastic Modified Flows for Riemannian Stochastic Gradient Descent
by: Gess, Benjamin, et al.
Published: (2024)

Infinite-dimensional Mahalanobis Distance with Applications to Kernelized Novelty Detection
by: Zozoulenko, Nikita, et al.
Published: (2024)

A weak MLMC scheme for Lévy-copula-driven SDEs with applications to the pricing of credit, equity and interest rate derivatives
by: Mijatović, Aleksandar, et al.
Published: (2022)

Optimal Initialization in Depth: Lyapunov Initialization and Limit Theorems for Deep Leaky ReLU Networks
by: Kogler, Constantin, et al.
Published: (2026)

Annealed Stein Variational Gradient Descent for Improved Uncertainty Estimation in Full-Waveform Inversion
by: Corrales, Miguel, et al.
Published: (2024)

Duality and Policy Evaluation in Distributionally Robust Bayesian Diffusion Control
by: Blanchet, Jose, et al.
Published: (2025)

Analysing heavy-tail properties of Stochastic Gradient Descent by means of Stochastic Recurrence Equations
by: Damek, Ewa, et al.
Published: (2024)

Value Mirror Descent for Reinforcement Learning
by: Jia, Zhichao, et al.
Published: (2026)

Self-Repellent Random Walks on General Graphs -- Achieving Minimal Sampling Variance via Nonlinear Markov Chains
by: Doshi, Vishwaraj, et al.
Published: (2023)

A Gaussian Comparison Theorem for Training Dynamics in Machine Learning
by: Panahi, Ashkan
Published: (2026)