Image de couverture de livre

High-Dimensional Privacy-Utility Dynamics of Noisy Stochastic Gradient Descent on Least Squares

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lin, Shurong, Kolaczyk, Eric D., Smith, Adam, Paquette, Elliot
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Differentially Private Linear Regression with Linked Data
par: Lin, Shurong, et autres
Publié: (2023)

Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent
par: Schertzer, Adrien, et autres
Publié: (2024)

Dynamics of Stochastic Momentum with Sparse Updates in High Dimensions
par: Everett, Katie, et autres
Publié: (2026)

To Clip or not to Clip: the Dynamics of SGD with Gradient Clipping in High-Dimensions
par: Marshall, Noah, et autres
Publié: (2024)

Convergence Rates for Gradient Descent on the Edge of Stability in Overparametrised Least Squares
par: MacDonald, Lachlan Ewen, et autres
Publié: (2025)

Statistical Guarantees for High-Dimensional Stochastic Gradient Descent
par: Li, Jiaqi, et autres
Publié: (2025)

Certified Machine Unlearning via Noisy Stochastic Gradient Descent
par: Chien, Eli, et autres
Publié: (2024)

ORFit: One-Pass Learning via Bridging Orthogonal Gradient Descent and Recursive Least-Squares
par: Min, Youngjae, et autres
Publié: (2022)

Transformers Don't In-Context Learn Least Squares Regression
par: Hill, Joshua, et autres
Publié: (2025)

Spectral Lens: Activation and Gradient Spectra as Diagnostics of LLM Optimization
par: Liu, Andy Zeyi, et autres
Publié: (2026)

High-Dimensional Partial Least Squares: Spectral Analysis and Fundamental Limitations
par: Léger, Victor, et autres
Publié: (2025)

Hybrid Least Squares/Gradient Descent Methods for DeepONets
par: Choi, Jun, et autres
Publié: (2025)

Iterative Pre-Conditioning for Expediting the Gradient-Descent Method: The Distributed Linear Least-Squares Problem
par: Chakrabarti, Kushal, et autres
Publié: (2020)

Least Squares Regression Can Exhibit Under-Parameterized Double Descent
par: Li, Xinyue, et autres
Publié: (2023)

Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks
par: Rangriz, Parsa
Publié: (2025)

Eigenvalue distribution of the Neural Tangent Kernel in the quadratic scaling
par: Benigni, Lucas, et autres
Publié: (2025)

SVD-Preconditioned Gradient Descent Method for Solving Nonlinear Least Squares Problems
par: Chang, Zhipeng, et autres
Publié: (2026)

The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms
par: Collins-Woodfin, Elizabeth, et autres
Publié: (2024)

Learning Curves of Stochastic Gradient Descent in Kernel Regression
par: Zhang, Haihan, et autres
Publié: (2025)

Individual Privacy Accounting for Differentially Private Stochastic Gradient Descent
par: Yu, Da, et autres
Publié: (2022)

Partitioned Least Squares
par: Esposito, Roberto, et autres
Publié: (2020)

Stochastic Adaptive Gradient Descent Without Descent
par: Aujol, Jean-François, et autres
Publié: (2025)

On the Generalization of Stochastic Gradient Descent with Momentum
par: Ramezani-Kebrya, Ali, et autres
Publié: (2018)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
par: Lu, Eric
Publié: (2025)

Stochastic Gradient Descent for Gaussian Processes Done Right
par: Lin, Jihao Andreas, et autres
Publié: (2023)

Mirror Descent Algorithms with Nearly Dimension-Independent Rates for Differentially-Private Stochastic Saddle-Point Problems
par: González, Tomás, et autres
Publié: (2024)

P3LS: Partial Least Squares under Privacy Preservation
par: Duy, Du Nguyen, et autres
Publié: (2024)

Insufficient Statistics Perturbation: Stable Estimators for Private Least Squares
par: Brown, Gavin, et autres
Publié: (2024)

Almost Bayesian: The Fractal Dynamics of Stochastic Gradient Descent
par: Hennick, Max, et autres
Publié: (2025)

A Bootstrap Perspective on Stochastic Gradient Descent
par: Lan, Hongjian, et autres
Publié: (2025)

Descend or Rewind? Stochastic Gradient Descent Unlearning
par: Mu, Siqiao, et autres
Publié: (2025)

Adjacent Leader Decentralized Stochastic Gradient Descent
par: He, Haoze, et autres
Publié: (2024)

Stochastic Gradient Descent for Nonparametric Additive Regression
par: Chen, Xin, et autres
Publié: (2024)

Bolstering Stochastic Gradient Descent with Model Building
par: Birbil, S. Ilker, et autres
Publié: (2021)

Stochastic Gradient Descent with Strategic Querying
par: Jiang, Nanfei, et autres
Publié: (2025)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)

Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning
par: Chemnitz, Dennis, et autres
Publié: (2024)

Two-Point Deterministic Equivalence for Stochastic Gradient Dynamics in Linear Models
par: Atanasov, Alexander, et autres
Publié: (2025)

The Computational Advantage of Depth: Learning High-Dimensional Hierarchical Functions with Gradient Descent
par: Dandi, Yatin, et autres
Publié: (2025)

Learning High-Dimensional Parity Functions with Product Networks using Gradient Descent
par: Larue, Guillaume, et autres
Publié: (2026)