Image de couverture de livre

Statistical Guarantees for High-Dimensional Stochastic Gradient Descent

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Jiaqi, Lou, Zhipeng, Schmidt-Hieber, Johannes, Wu, Wei Biao
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Asymptotics of Stochastic Gradient Descent with Dropout Regularization in Linear Models
par: Li, Jiaqi, et autres
Publié: (2024)

Central Limit Theorems for Stochastic Gradient Descent Quantile Estimators
par: Wei, Ziyang, et autres
Publié: (2025)

Improving the Convergence Rates of Forward Gradient Descent with Repeated Sampling
par: Dexheimer, Niklas, et autres
Publié: (2024)

Weighted Averaged Stochastic Gradient Descent: Asymptotic Normality and Optimality
par: Wei, Ziyang, et autres
Publié: (2023)

High Confidence Level Inference is Almost Free using Parallel Stochastic Optimization
par: Zhu, Wanrong, et autres
Publié: (2024)

Refining Covariance Matrix Estimation in Stochastic Gradient Descent Through Bias Reduction
par: Wei, Ziyang, et autres
Publié: (2026)

Training Diagonal Linear Networks with Stochastic Sharpness-Aware Minimization
par: Clara, Gabriel, et autres
Publié: (2025)

Statistical Inference for Differentially Private Stochastic Gradient Descent
par: Xia, Xintao, et autres
Publié: (2025)

Online Statistical Inference for Contextual Bandits via Stochastic Gradient Descent
par: Chang, Xiangyu, et autres
Publié: (2022)

High-Dimensional Privacy-Utility Dynamics of Noisy Stochastic Gradient Descent on Least Squares
par: Lin, Shurong, et autres
Publié: (2025)

Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training
par: Zhao, Shen-Yi, et autres
Publié: (2020)

Nonlinear Stochastic Gradient Descent and Heavy-tailed Noise: A Unified Framework and High-probability Guarantees
par: Armacki, Aleksandar, et autres
Publié: (2024)

Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks
par: Rangriz, Parsa
Publié: (2025)

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation
par: Mishkin, Aaron, et autres
Publié: (2024)

Sharp asymptotic theory for Q-learning with LDTZ learning rate and its generalization
par: Bonnerjee, Soham, et autres
Publié: (2026)

Gradient Manipulation in Distributed Stochastic Gradient Descent with Strategic Agents: Truthful Incentives with Convergence Guarantees
par: Chen, Ziqin, et autres
Publié: (2026)

Probabilistic Guarantees of Stochastic Recursive Gradient in Non-Convex Finite Sum Problems
par: Zhong, Yanjie, et autres
Publié: (2024)

Gaussian Process Inference Using Mini-batch Stochastic Gradient Descent: Convergence Guarantees and Empirical Benefits
par: Chen, Hao, et autres
Publié: (2021)

High-Dimensional Sparse Data Low-rank Representation via Accelerated Asynchronous Parallel Stochastic Gradient Descent
par: Hu, Qicong, et autres
Publié: (2024)

Stochastic Adaptive Gradient Descent Without Descent
par: Aujol, Jean-François, et autres
Publié: (2025)

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
par: Ziyin, Liu, et autres
Publié: (2024)

On the Generalization of Stochastic Gradient Descent with Momentum
par: Ramezani-Kebrya, Ali, et autres
Publié: (2018)

Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent
par: Deng, Xiaoge, et autres
Publié: (2023)

Central limit theorems for the outputs of fully convolutional neural networks with time series input
par: Betken, Annika, et autres
Publié: (2026)

A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent
par: Wang, Mingze, et autres
Publié: (2023)

Guaranteed Nonconvex Low-Rank Tensor Estimation via Scaled Gradient Descent
par: Wu, Tong
Publié: (2025)

Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks
par: Wang, Puyu, et autres
Publié: (2023)

Differentially Private Stochastic Gradient Descent with Fixed-Size Minibatches: Tighter RDP Guarantees with or without Replacement
par: Birrell, Jeremiah, et autres
Publié: (2024)

Spike-timing-dependent Hebbian learning as noisy gradient descent
par: Dexheimer, Niklas, et autres
Publié: (2025)

On the VC dimension of deep group convolutional neural networks
par: Sepliarskaia, Anna, et autres
Publié: (2024)

Dropout Regularization Versus $\ell_2$-Penalization in the Linear Model
par: Clara, Gabriel, et autres
Publié: (2023)

A Bootstrap Perspective on Stochastic Gradient Descent
par: Lan, Hongjian, et autres
Publié: (2025)

Descend or Rewind? Stochastic Gradient Descent Unlearning
par: Mu, Siqiao, et autres
Publié: (2025)

Adjacent Leader Decentralized Stochastic Gradient Descent
par: He, Haoze, et autres
Publié: (2024)

Stochastic Gradient Descent for Nonparametric Additive Regression
par: Chen, Xin, et autres
Publié: (2024)

Bolstering Stochastic Gradient Descent with Model Building
par: Birbil, S. Ilker, et autres
Publié: (2021)

Generalization Guarantees on Data-Driven Tuning of Gradient Descent with Langevin Updates
par: Goyal, Saumya, et autres
Publié: (2026)

The Implicit Bias of Steepest Descent with Mini-batch Stochastic Gradient
par: Li, Jichu, et autres
Publié: (2026)

Stochastic Gradient Descent with Strategic Querying
par: Jiang, Nanfei, et autres
Publié: (2025)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)