Cover Image

High-dimensional scaling limits and fluctuations of online least-squares SGD with smooth covariance

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Balasubramanian, Krishnakumar, Ghosal, Promit, He, Ye
Format:	Preprint
Published:	2023
Subjects:	Probability Optimization and Control Statistics Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Statistical Inference for Linear Functionals of Online SGD in High-dimensional Linear Regression
by: Agrawalla, Bhavya, et al.
Published: (2023)

Improved Finite-Particle Convergence Rates for Stein Variational Gradient Descent
by: Banerjee, Sayan, et al.
Published: (2024)

Statistical Inference for Linear Functionals of Online Least-squares SGD when $t \gtrsim d^{1+δ}$
by: Agrawalla, Bhavya, et al.
Published: (2025)

A Piecewise Lyapunov Analysis of Sub-quadratic SGD: Applications to Robust and Quantile Regression
by: Zhang, Yixuan, et al.
Published: (2025)

Finite-Particle Rates for Regularized Stein Variational Gradient Descent
by: He, Ye, et al.
Published: (2026)

High-dimensional Limit of SGD for Diagonal Linear Networks
by: Malaxechebarría, Begoña García, et al.
Published: (2026)

High dimensional analysis reveals conservative sharpening and a stochastic edge of stability
by: Agarwala, Atish, et al.
Published: (2024)

Risk reversal for least squares estimators under nested convex constraints
by: Al-Ghattas, Omar
Published: (2026)

Central limit theorems for vector-valued composite functionals with smoothing and applications
by: Chen, Huihui, et al.
Published: (2024)

Orlicz regrets to consistently bound statistics of random variables with an application to environmental indicators
by: Yoshioka, Hidekazu, et al.
Published: (2023)

Fast Spawn\&Prune (FS\&P): Global convergence of stochastic conic particle gradient descent via birth/death process
by: De Castro, Yohann, et al.
Published: (2026)

Optimal and instance-dependent guarantees for Markovian linear stochastic approximation
by: Mou, Wenlong, et al.
Published: (2021)

Convergence of coordinate ascent variational inference for log-concave measures via optimal transport
by: Arnese, Manuel, et al.
Published: (2024)

Alternating minimization for generalized rank one matrix sensing: Sharp predictions from a random initialization
by: Chandrasekher, Kabir Aladin, et al.
Published: (2022)

4+3 Phases of Compute-Optimal Neural Scaling Laws
by: Paquette, Elliot, et al.
Published: (2024)

Early Stopping in Contextual Bandits and Inferences
by: Cui, Zihan
Published: (2025)

Statistical guarantees for continuous-time policy evaluation: blessing of ellipticity and new tradeoffs
by: Mou, Wenlong
Published: (2025)

Is RL fine-tuning harder than regression? A PDE learning approach for diffusion models
by: Mou, Wenlong
Published: (2025)

Finite-Dimensional Gaussian Approximation for Deep Neural Networks: Universality in Random Weights
by: Balasubramanian, Krishnakumar, et al.
Published: (2025)

Markov Kernels, Distances and Optimal Control: A Parable of Linear Quadratic Non-Gaussian Distribution Steering
by: Teter, Alexis M. H., et al.
Published: (2025)

Convergence rate of random scan Coordinate Ascent Variational Inference under log-concavity
by: Lavenant, Hugo, et al.
Published: (2024)

Efficient Online Learning in Interacting Particle Systems
by: Sharrock, Louis, et al.
Published: (2026)

Non-convex matrix sensing: Breaking the quadratic rank barrier in the sample complexity
by: Stöger, Dominik, et al.
Published: (2024)

Contributions to Robust and Efficient Methods for Analysis of High Dimensional Data
by: Yang, Kai
Published: (2025)

Propagation of Chaos in Contextual Flow Maps
by: Chen, Shi, et al.
Published: (2026)

Optimal estimators of cross-partial derivatives and surrogates of functions
by: Lamboni, Matieyendou
Published: (2024)

The Risk Quadrangle in Optimization: An Overview with Recent Results and Extensions
by: Grechuk, Bogdan, et al.
Published: (2026)

Gaussian random field approximation via Stein's method with applications to wide random neural networks
by: Balasubramanian, Krishnakumar, et al.
Published: (2023)

Multivariate Gaussian Approximation for Random Forest via Region-based Stabilization
by: Shi, Zhaoyang, et al.
Published: (2024)

Meta-Learning with Generalized Ridge Regression: High-dimensional Asymptotics, Optimality and Hyper-covariance Estimation
by: Jin, Yanhao, et al.
Published: (2024)

New algorithms for sampling and diffusion models
by: Zhang, Xicheng
Published: (2024)

Gaussian and Bootstrap Approximation for Matching-based Average Treatment Effect Estimators
by: Shi, Zhaoyang, et al.
Published: (2024)

Off-policy estimation with adaptively collected data: the power of online learning
by: Lee, Jeonghwan, et al.
Published: (2024)

Entropic Selection Principle for Monge's Optimal Transport
by: Aryan, Shrey, et al.
Published: (2025)

Convergence of SGD for Training Neural Networks with Sliced Wasserstein Losses
by: Tanguy, Eloi
Published: (2023)

Optimal transport and Wasserstein distances for causal models
by: Cheridito, Patrick, et al.
Published: (2023)

Optimal distributions for randomized unbiased estimators with an infinite horizon and an adaptive algorithm
by: Zheng, Chao, et al.
Published: (2023)

Sharp Rates of MMD Empirical Estimation with Power Kernels
by: Colasanto, Francesco, et al.
Published: (2026)

Wasserstein Distributionally Robust Optimization with Heterogeneous Data Sources
by: Rychener, Yves, et al.
Published: (2024)

Universality of high-dimensional scaling limits of stochastic gradient descent
by: Gheissari, Reza, et al.
Published: (2025)