Imagen de Portada

Statistical Guarantees for High-Dimensional Stochastic Gradient Descent

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Jiaqi, Lou, Zhipeng, Schmidt-Hieber, Johannes, Wu, Wei Biao
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Asymptotics of Stochastic Gradient Descent with Dropout Regularization in Linear Models
por: Li, Jiaqi, et al.
Publicado: (2024)

Central Limit Theorems for Stochastic Gradient Descent Quantile Estimators
por: Wei, Ziyang, et al.
Publicado: (2025)

Improving the Convergence Rates of Forward Gradient Descent with Repeated Sampling
por: Dexheimer, Niklas, et al.
Publicado: (2024)

Weighted Averaged Stochastic Gradient Descent: Asymptotic Normality and Optimality
por: Wei, Ziyang, et al.
Publicado: (2023)

High Confidence Level Inference is Almost Free using Parallel Stochastic Optimization
por: Zhu, Wanrong, et al.
Publicado: (2024)

Refining Covariance Matrix Estimation in Stochastic Gradient Descent Through Bias Reduction
por: Wei, Ziyang, et al.
Publicado: (2026)

Training Diagonal Linear Networks with Stochastic Sharpness-Aware Minimization
por: Clara, Gabriel, et al.
Publicado: (2025)

Statistical Inference for Differentially Private Stochastic Gradient Descent
por: Xia, Xintao, et al.
Publicado: (2025)

Online Statistical Inference for Contextual Bandits via Stochastic Gradient Descent
por: Chang, Xiangyu, et al.
Publicado: (2022)

High-Dimensional Privacy-Utility Dynamics of Noisy Stochastic Gradient Descent on Least Squares
por: Lin, Shurong, et al.
Publicado: (2025)

Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training
por: Zhao, Shen-Yi, et al.
Publicado: (2020)

Nonlinear Stochastic Gradient Descent and Heavy-tailed Noise: A Unified Framework and High-probability Guarantees
por: Armacki, Aleksandar, et al.
Publicado: (2024)

Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks
por: Rangriz, Parsa
Publicado: (2025)

Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation
por: Mishkin, Aaron, et al.
Publicado: (2024)

Sharp asymptotic theory for Q-learning with LDTZ learning rate and its generalization
por: Bonnerjee, Soham, et al.
Publicado: (2026)

Gradient Manipulation in Distributed Stochastic Gradient Descent with Strategic Agents: Truthful Incentives with Convergence Guarantees
por: Chen, Ziqin, et al.
Publicado: (2026)

Probabilistic Guarantees of Stochastic Recursive Gradient in Non-Convex Finite Sum Problems
por: Zhong, Yanjie, et al.
Publicado: (2024)

Gaussian Process Inference Using Mini-batch Stochastic Gradient Descent: Convergence Guarantees and Empirical Benefits
por: Chen, Hao, et al.
Publicado: (2021)

High-Dimensional Sparse Data Low-rank Representation via Accelerated Asynchronous Parallel Stochastic Gradient Descent
por: Hu, Qicong, et al.
Publicado: (2024)

Stochastic Adaptive Gradient Descent Without Descent
por: Aujol, Jean-François, et al.
Publicado: (2025)

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
por: Ziyin, Liu, et al.
Publicado: (2024)

On the Generalization of Stochastic Gradient Descent with Momentum
por: Ramezani-Kebrya, Ali, et al.
Publicado: (2018)

Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent
por: Deng, Xiaoge, et al.
Publicado: (2023)

A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent
por: Wang, Mingze, et al.
Publicado: (2023)

Central limit theorems for the outputs of fully convolutional neural networks with time series input
por: Betken, Annika, et al.
Publicado: (2026)

Guaranteed Nonconvex Low-Rank Tensor Estimation via Scaled Gradient Descent
por: Wu, Tong
Publicado: (2025)

Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks
por: Wang, Puyu, et al.
Publicado: (2023)

Differentially Private Stochastic Gradient Descent with Fixed-Size Minibatches: Tighter RDP Guarantees with or without Replacement
por: Birrell, Jeremiah, et al.
Publicado: (2024)

Spike-timing-dependent Hebbian learning as noisy gradient descent
por: Dexheimer, Niklas, et al.
Publicado: (2025)

On the VC dimension of deep group convolutional neural networks
por: Sepliarskaia, Anna, et al.
Publicado: (2024)

Dropout Regularization Versus $\ell_2$-Penalization in the Linear Model
por: Clara, Gabriel, et al.
Publicado: (2023)

A Bootstrap Perspective on Stochastic Gradient Descent
por: Lan, Hongjian, et al.
Publicado: (2025)

Descend or Rewind? Stochastic Gradient Descent Unlearning
por: Mu, Siqiao, et al.
Publicado: (2025)

Adjacent Leader Decentralized Stochastic Gradient Descent
por: He, Haoze, et al.
Publicado: (2024)

Stochastic Gradient Descent for Nonparametric Additive Regression
por: Chen, Xin, et al.
Publicado: (2024)

Bolstering Stochastic Gradient Descent with Model Building
por: Birbil, S. Ilker, et al.
Publicado: (2021)

Generalization Guarantees on Data-Driven Tuning of Gradient Descent with Langevin Updates
por: Goyal, Saumya, et al.
Publicado: (2026)

The Implicit Bias of Steepest Descent with Mini-batch Stochastic Gradient
por: Li, Jichu, et al.
Publicado: (2026)

Stochastic Gradient Descent with Strategic Querying
por: Jiang, Nanfei, et al.
Publicado: (2025)

Stochastic Gradient Descent with Adaptive Data
por: Che, Ethan, et al.
Publicado: (2024)