Cover Image

Exact Mean Square Linear Stability Analysis for SGD

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mulayoff, Rotem, Michaeli, Tomer
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Hierarchical Uncertainty Exploration via Feedforward Posterior Trees
by: Nehme, Elias, et al.
Published: (2024)

On the Stability of Nonlinear Dynamics in GD and SGD: Beyond Quadratic Potentials
by: Mulayoff, Rotem, et al.
Published: (2026)

The Expected Loss of Preconditioned Langevin Dynamics Reveals the Hessian Rank
by: Bar, Amitay, et al.
Published: (2024)

Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Models
by: Haas, René, et al.
Published: (2023)

LoRA vs. Full Fine-Tuning: A Theoretical Perspective
by: Zindari, Ali, et al.
Published: (2026)

Learning When to Adapt
by: Zindari, Ali, et al.
Published: (2026)

Coherence Awareness in Diffractive Neural Networks
by: Kleiner, Matan, et al.
Published: (2024)

Illumination Angular Spectrum Encoding for Controlling the Functionality of Diffractive Networks
by: Kleiner, Matan, et al.
Published: (2026)

On the Posterior Distribution in Denoising: Application to Uncertainty Quantification
by: Manor, Hila, et al.
Published: (2023)

Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversion
by: Manor, Hila, et al.
Published: (2024)

Joint auto-encoders: a flexible multi-task learning framework
by: Epstein, Baruch, et al.
Published: (2017)

Classification Diffusion Models: Revitalizing Density Ratio Estimation
by: Yadin, Shahar, et al.
Published: (2024)

From Continual Learning to SGD and Back: Better Rates for Continual Linear Models
by: Evron, Itay, et al.
Published: (2025)

FlowOpt: Fast Optimization Through Whole Flow Processes for Training-Free Editing
by: Ronai, Or, et al.
Published: (2025)

Minibatch and Local SGD: Algorithmic Stability and Linear Speedup in Generalization
by: Lei, Yunwen, et al.
Published: (2023)

An Edit Friendly DDPM Noise Space: Inversion and Manipulations
by: Huberman-Spiegelglas, Inbar, et al.
Published: (2023)

Adaptive Compressed Sensing with Diffusion-Based Posterior Sampling
by: Elata, Noam, et al.
Published: (2024)

Improving Implicit Regularization of SGD with Preconditioning for Least Square Problems
by: Su, Junwei, et al.
Published: (2024)

SGD and Weight Decay Secretly Minimize the Rank of Your Neural Network
by: Galanti, Tomer, et al.
Published: (2022)

The Perception-Robustness Tradeoff in Deterministic Image Restoration
by: Ohayon, Guy, et al.
Published: (2023)

Perceptual Fairness in Image Restoration
by: Ohayon, Guy, et al.
Published: (2024)

Fast Last-Iterate Convergence of SGD in the Smooth Interpolation Regime
by: Attia, Amit, et al.
Published: (2025)

Stability and Generalization for Decentralized Markov SGD
by: Wang, Jiahuan, et al.
Published: (2026)

A Simplified Analysis of SGD for Linear Regression with Weight Averaging
by: Meterez, Alexandru, et al.
Published: (2025)

Data Deletion for Linear Regression with Noisy SGD
by: Xia, Zhangjie, et al.
Published: (2024)

FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models
by: Kulikov, Vladimir, et al.
Published: (2024)

When Diffusion Models Memorize: Inductive Biases in Probability Flow of Minimum-Norm Shallow Neural Nets
by: Zeno, Chen, et al.
Published: (2025)

From Posterior Sampling to Meaningful Diversity in Image Restoration
by: Cohen, Noa, et al.
Published: (2023)

GSURE-Based Diffusion Model Training with Corrupted Data
by: Kawar, Bahjat, et al.
Published: (2023)

Does SGD Seek Flatness or Sharpness? An Exactly Solvable Model
by: Xu, Yizhou, et al.
Published: (2026)

Reasons for the Superiority of Stochastic Estimators over Deterministic Ones: Robustness, Consistency and Perceptual Quality
by: Ohayon, Guy, et al.
Published: (2022)

Bootstrap SGD: Algorithmic Stability and Robustness
by: Christmann, Andreas, et al.
Published: (2024)

Edge of Stochastic Stability: Revisiting the Edge of Stability for SGD
by: Andreyev, Arseniy, et al.
Published: (2024)

Improved Stability and Generalization Guarantees of the Decentralized SGD Algorithm
by: Bars, Batiste Le, et al.
Published: (2023)

MineTheGap: Automatic Mining of Biases in Text-to-Image Models
by: Cohen, Noa, et al.
Published: (2025)

Scaling Laws of SignSGD in Linear Regression: When Does It Outperform SGD?
by: Kim, Jihwan, et al.
Published: (2026)

Exact Risk Curves of signSGD in High-Dimensions: Quantifying Preconditioning and Noise-Compression Effects
by: Xiao, Ke Liang, et al.
Published: (2024)

Accelerating Single-Pass SGD for Generalized Linear Prediction
by: Chen, Qian, et al.
Published: (2026)

A Unified Stability Analysis of SAM vs SGD: Role of Data Coherence and Emergence of Simplicity Bias
by: Chang, Wei-Kai, et al.
Published: (2025)

From Privacy to Generalization: Linear Max-Information Bounds for DP-SGD
by: Lampert, Christoph H., et al.
Published: (2026)