Image de couverture de livre

A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Mingze, Wu, Lei
Format:	Preprint
Publié:	2023
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
par: Ziyin, Liu, et autres
Publié: (2024)

Information-Theoretic Generalization Bounds for Stochastic Gradient Descent with Predictable Virtual Noise
par: Partohaghighi, Mohammad
Publié: (2026)

Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent
par: Sato, Naoki, et autres
Publié: (2024)

Noise Balance and Stationary Distribution of Stochastic Gradient Descent
par: Ziyin, Liu, et autres
Publié: (2023)

Stochastic Gradient Descent with Momentum is Algorithmically Stable
par: Lei, Yunwen, et autres
Publié: (2026)

Stochastic Gradient Descent for Two-layer Neural Networks
par: Cao, Dinghao, et autres
Publié: (2024)

Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent
par: Vaswani, Sharan, et autres
Publié: (2021)

Adjacent Leader Decentralized Stochastic Gradient Descent
par: He, Haoze, et autres
Publié: (2024)

Stochastic Adaptive Gradient Descent Without Descent
par: Aujol, Jean-François, et autres
Publié: (2025)

On the Generalization of Stochastic Gradient Descent with Momentum
par: Ramezani-Kebrya, Ali, et autres
Publié: (2018)

A Bootstrap Perspective on Stochastic Gradient Descent
par: Lan, Hongjian, et autres
Publié: (2025)

Statistical Guarantees for High-Dimensional Stochastic Gradient Descent
par: Li, Jiaqi, et autres
Publié: (2025)

DOME: Improving Signal-to-Noise in Stochastic Gradient Descent via Sharp-Direction Subspace Filtering
par: Nicolas, Julien, et autres
Publié: (2025)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
par: Li, Tianyou, et autres
Publié: (2023)

Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise
par: Dang, Thanh, et autres
Publié: (2025)

Weighted Averaged Stochastic Gradient Descent: Asymptotic Normality and Optimality
par: Wei, Ziyang, et autres
Publié: (2023)

A Unified Analysis of Stochastic Gradient Descent with Arbitrary Data Permutations and Beyond
par: Li, Yipeng, et autres
Publié: (2025)

Central Limit Theorems for Stochastic Gradient Descent Quantile Estimators
par: Wei, Ziyang, et autres
Publié: (2025)

Stochastic Gradient Descent for Nonparametric Additive Regression
par: Chen, Xin, et autres
Publié: (2024)

Bolstering Stochastic Gradient Descent with Model Building
par: Birbil, S. Ilker, et autres
Publié: (2021)

Descend or Rewind? Stochastic Gradient Descent Unlearning
par: Mu, Siqiao, et autres
Publié: (2025)

Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training
par: Zhao, Shen-Yi, et autres
Publié: (2020)

Cheap Bootstrap for Fast Uncertainty Quantification of Stochastic Gradient Descent
par: Lam, Henry, et autres
Publié: (2023)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)

Stochastic Gradient Descent with Strategic Querying
par: Jiang, Nanfei, et autres
Publié: (2025)

Learning Operators with Stochastic Gradient Descent in General Hilbert Spaces
par: Shi, Lei, et autres
Publié: (2024)

Nonlinear Stochastic Gradient Descent and Heavy-tailed Noise: A Unified Framework and High-probability Guarantees
par: Armacki, Aleksandar, et autres
Publié: (2024)

Generalization Bounds of Stochastic Gradient Descent in Homogeneous Neural Networks
par: Ma, Wenquan, et autres
Publié: (2026)

Stochastic Gradient Descent for Gaussian Processes Done Right
par: Lin, Jihao Andreas, et autres
Publié: (2023)

Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent
par: Deng, Xiaoge, et autres
Publié: (2023)

Personalized Federated Learning with Exact Stochastic Gradient Descent
par: Nikoloutsopoulos, Sotirios, et autres
Publié: (2022)

Variational Stochastic Gradient Descent for Deep Neural Networks
par: Chen, Haotian, et autres
Publié: (2024)

Towards Learning Stochastic Population Models by Gradient Descent
par: Kreikemeyer, Justin N., et autres
Publié: (2024)

Learning Curves of Stochastic Gradient Descent in Kernel Regression
par: Zhang, Haihan, et autres
Publié: (2025)

An ADRC-Incorporated Stochastic Gradient Descent Algorithm for Latent Factor Analysis
par: Li, Jinli, et autres
Publié: (2024)

Learning Operators by Regularized Stochastic Gradient Descent with Operator-valued Kernels
par: Yang, Jia-Qi, et autres
Publié: (2025)

Adaptive Batch Sizes Using Non-Euclidean Gradient Noise Scales for Stochastic Sign and Spectral Descent
par: Naganuma, Hiroki, et autres
Publié: (2026)

Refining Covariance Matrix Estimation in Stochastic Gradient Descent Through Bias Reduction
par: Wei, Ziyang, et autres
Publié: (2026)

Adaptive Heavy-Tailed Stochastic Gradient Descent
par: Gong, Bodu, et autres
Publié: (2025)

Streaming Krylov-Accelerated Stochastic Gradient Descent
par: Thomas, Stephen
Publié: (2025)