Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent
Fuente:
arXiv
Saved in:
| Main Authors: | Schertzer, Adrien, Pillaud-Vivien, Loucas |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Joint Learning in the Gaussian Single Index Model
by: Pillaud-Vivien, Loucas, et al.
Published: (2025)
by: Pillaud-Vivien, Loucas, et al.
Published: (2025)
Neural Laplace for learning Stochastic Differential Equations
by: Carrel, Adrien
Published: (2024)
by: Carrel, Adrien
Published: (2024)
Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs
by: Boursier, Etienne, et al.
Published: (2022)
by: Boursier, Etienne, et al.
Published: (2022)
Oscillating solutions to the mean-field Langevin descent-ascent flow
by: Mourrat, Jean-Christophe, et al.
Published: (2026)
by: Mourrat, Jean-Christophe, et al.
Published: (2026)
Limit Theorems for Stochastic Gradient Descent with Infinite Variance
by: Blanchet, Jose, et al.
Published: (2024)
by: Blanchet, Jose, et al.
Published: (2024)
Towards Continuous-Time Approximations for Stochastic Gradient Descent without Replacement
by: Perko, Stefan
Published: (2025)
by: Perko, Stefan
Published: (2025)
Convergence of Shallow ReLU Networks on Weakly Interacting Data
by: Dana, Léo, et al.
Published: (2025)
by: Dana, Léo, et al.
Published: (2025)
Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning
by: Chemnitz, Dennis, et al.
Published: (2024)
by: Chemnitz, Dennis, et al.
Published: (2024)
Parameter Estimation in Stochastic Differential Equations via Wiener Chaos Expansion and Stochastic Gradient Descent
by: Delgado-Vences, Francisco, et al.
Published: (2026)
by: Delgado-Vences, Francisco, et al.
Published: (2026)
Approximation to Deep Q-Network by Stochastic Delay Differential Equations
by: Lu, Jianya, et al.
Published: (2025)
by: Lu, Jianya, et al.
Published: (2025)
Controlling the Flow: Stability and Convergence for Stochastic Gradient Descent with Decaying Regularization
by: Kassing, Sebastian, et al.
Published: (2025)
by: Kassing, Sebastian, et al.
Published: (2025)
Squared Wasserstein-2 Distance for Efficient Reconstruction of Stochastic Differential Equations
by: Xia, Mingtao, et al.
Published: (2024)
by: Xia, Mingtao, et al.
Published: (2024)
A Complete Decomposition of Stochastic Differential Equations
by: Duffield, Samuel
Published: (2026)
by: Duffield, Samuel
Published: (2026)
Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks
by: Rangriz, Parsa
Published: (2025)
by: Rangriz, Parsa
Published: (2025)
Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise
by: Dang, Thanh, et al.
Published: (2025)
by: Dang, Thanh, et al.
Published: (2025)
Variational Inference for Uncertainty Quantification: an Analysis of Trade-offs
by: Margossian, Charles C., et al.
Published: (2024)
by: Margossian, Charles C., et al.
Published: (2024)
Exact Dynamics of Multi-class Stochastic Gradient Descent
by: Collins-Woodfin, Elizabeth, et al.
Published: (2025)
by: Collins-Woodfin, Elizabeth, et al.
Published: (2025)
Diffusion-Based Stochastic Operator Networks for Uncertainty Quantification in Stochastic Partial Differential Equations
by: Huynh, Phuoc-Toan, et al.
Published: (2026)
by: Huynh, Phuoc-Toan, et al.
Published: (2026)
High-Dimensional Privacy-Utility Dynamics of Noisy Stochastic Gradient Descent on Least Squares
by: Lin, Shurong, et al.
Published: (2025)
by: Lin, Shurong, et al.
Published: (2025)
Type-II Saddles and Probabilistic Stability of Stochastic Gradient Descent
by: Ziyin, Liu, et al.
Published: (2023)
by: Ziyin, Liu, et al.
Published: (2023)
Stochastic Gradient Descent Revisited
by: Louzi, Azar
Published: (2024)
by: Louzi, Azar
Published: (2024)
Computational-Statistical Gaps in Gaussian Single-Index Models
by: Damian, Alex, et al.
Published: (2024)
by: Damian, Alex, et al.
Published: (2024)
Analysing heavy-tail properties of Stochastic Gradient Descent by means of Stochastic Recurrence Equations
by: Damek, Ewa, et al.
Published: (2024)
by: Damek, Ewa, et al.
Published: (2024)
Decentralized Proximal Stochastic Gradient Langevin Dynamics
by: Islam, Mohammad Rafiqul, et al.
Published: (2026)
by: Islam, Mohammad Rafiqul, et al.
Published: (2026)
Dichotomy of Feature Learning and Unlearning: Fast-Slow Analysis on Neural Networks with Stochastic Gradient Descent
by: Imai, Shota, et al.
Published: (2026)
by: Imai, Shota, et al.
Published: (2026)
Modified Equations for Stochastic Optimization
by: Perko, Stefan
Published: (2025)
by: Perko, Stefan
Published: (2025)
Exact Gradients for Stochastic Spiking Neural Networks Driven by Rough Signals
by: Holberg, Christian, et al.
Published: (2024)
by: Holberg, Christian, et al.
Published: (2024)
Stochastic Modified Flows for Riemannian Stochastic Gradient Descent
by: Gess, Benjamin, et al.
Published: (2024)
by: Gess, Benjamin, et al.
Published: (2024)
Flatness-Aware Stochastic Gradient Langevin Dynamics
by: Bruno, Stefano, et al.
Published: (2025)
by: Bruno, Stefano, et al.
Published: (2025)
Gaussian Approximation and Multiplier Bootstrap for Stochastic Gradient Descent
by: Sheshukova, Marina, et al.
Published: (2025)
by: Sheshukova, Marina, et al.
Published: (2025)
Stochastic Operator Network: A Stochastic Maximum Principle Based Approach to Operator Learning
by: Bausback, Ryan, et al.
Published: (2025)
by: Bausback, Ryan, et al.
Published: (2025)
Weak Generative Sampler to Efficiently Sample Invariant Distribution of Stochastic Differential Equation
by: Cai, Zhiqiang, et al.
Published: (2024)
by: Cai, Zhiqiang, et al.
Published: (2024)
Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework
by: Yu, Siyuan, et al.
Published: (2024)
by: Yu, Siyuan, et al.
Published: (2024)
Random-Bridges as Stochastic Transports for Generative Models
by: Goria, Stefano, et al.
Published: (2025)
by: Goria, Stefano, et al.
Published: (2025)
Statistical Inference for Differentially Private Stochastic Gradient Descent
by: Xia, Xintao, et al.
Published: (2025)
by: Xia, Xintao, et al.
Published: (2025)
Is Learning in Biological Neural Networks based on Stochastic Gradient Descent? An analysis using stochastic processes
by: Christensen, Sören, et al.
Published: (2023)
by: Christensen, Sören, et al.
Published: (2023)
Partially Stochastic Infinitely Deep Bayesian Neural Networks
by: Calvo-Ordonez, Sergio, et al.
Published: (2024)
by: Calvo-Ordonez, Sergio, et al.
Published: (2024)
Stabilizing Temporal Difference Learning via Implicit Stochastic Recursion
by: Kim, Hwanwoo, et al.
Published: (2025)
by: Kim, Hwanwoo, et al.
Published: (2025)
Flow Matching: Markov Kernels, Stochastic Processes and Transport Plans
by: Wald, Christian, et al.
Published: (2025)
by: Wald, Christian, et al.
Published: (2025)
Stochastic Scaling Limits and Synchronization by Noise in Deep Transformer Models
by: Agazzi, Andrea, et al.
Published: (2026)
by: Agazzi, Andrea, et al.
Published: (2026)
Similar Items
-
Joint Learning in the Gaussian Single Index Model
by: Pillaud-Vivien, Loucas, et al.
Published: (2025) -
Neural Laplace for learning Stochastic Differential Equations
by: Carrel, Adrien
Published: (2024) -
Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs
by: Boursier, Etienne, et al.
Published: (2022) -
Oscillating solutions to the mean-field Langevin descent-ascent flow
by: Mourrat, Jean-Christophe, et al.
Published: (2026) -
Limit Theorems for Stochastic Gradient Descent with Infinite Variance
by: Blanchet, Jose, et al.
Published: (2024)