Cover Image

Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Deng, Xiaoge, Shen, Li, Li, Shengwei, Sun, Tao, Li, Dongsheng, Tao, Dacheng
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients
by: Luo, Ping, et al.
Published: (2024)

Towards Understanding Generalization and Stability Gaps between Centralized and Decentralized Federated Learning
by: Sun, Yan, et al.
Published: (2023)

Score-based Generative Models with Adaptive Momentum
by: Wen, Ziqing, et al.
Published: (2024)

Federated Prediction-Powered Inference from Decentralized Data
by: Luo, Ping, et al.
Published: (2024)

Communication-Efficient Distributed Learning via Sparse and Adaptive Stochastic Gradient
by: Deng, Xiaoge, et al.
Published: (2021)

A-FedPD: Aligning Dual-Drift is All Federated Primal-Dual Learning Needs
by: Sun, Yan, et al.
Published: (2024)

Rethinking the Personalized Relaxed Initialization in the Federated Learning: Consistency and Generalization
by: Shen, Li, et al.
Published: (2026)

Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training
by: Zhao, Shen-Yi, et al.
Published: (2020)

Sharpness-Aware Minimization with Adaptive Regularization for Training Deep Neural Networks
by: Zou, Jinping, et al.
Published: (2024)

Towards Learning Stochastic Population Models by Gradient Descent
by: Kreikemeyer, Justin N., et al.
Published: (2024)

The Implicit Bias of Steepest Descent with Mini-batch Stochastic Gradient
by: Li, Jichu, et al.
Published: (2026)

Statistical Guarantees for High-Dimensional Stochastic Gradient Descent
by: Li, Jiaqi, et al.
Published: (2025)

Noise Balance and Stationary Distribution of Stochastic Gradient Descent
by: Ziyin, Liu, et al.
Published: (2023)

Convergent Differential Privacy Analysis for General Federated Learning
by: Sun, Yan, et al.
Published: (2024)

Central Limit Theorems for Stochastic Gradient Descent Quantile Estimators
by: Wei, Ziyang, et al.
Published: (2025)

Revealing Modular Gradient Noise Imbalance in LLMs: Calibrating Adam via Signal-to-Noise Ratio
by: Wen, Ziqing, et al.
Published: (2026)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
by: Li, Tianyou, et al.
Published: (2023)

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
by: Ziyin, Liu, et al.
Published: (2024)

Stochastic Adaptive Gradient Descent Without Descent
by: Aujol, Jean-François, et al.
Published: (2025)

An ADRC-Incorporated Stochastic Gradient Descent Algorithm for Latent Factor Analysis
by: Li, Jinli, et al.
Published: (2024)

Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent
by: Li, Xiang, et al.
Published: (2024)

A Unified Analysis of Stochastic Gradient Descent with Arbitrary Data Permutations and Beyond
by: Li, Yipeng, et al.
Published: (2025)

On the Generalization of Stochastic Gradient Descent with Momentum
by: Ramezani-Kebrya, Ali, et al.
Published: (2018)

Certified Machine Unlearning via Noisy Stochastic Gradient Descent
by: Chien, Eli, et al.
Published: (2024)

TeZO: Empowering the Low-Rankness on the Temporal Dimension in the Zeroth-Order Optimization for Fine-tuning LLMs
by: Sun, Yan, et al.
Published: (2025)

Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework
by: Yu, Siyuan, et al.
Published: (2024)

Learning Multi-Agent Communication from Graph Modeling Perspective
by: Hu, Shengchao, et al.
Published: (2024)

Online Statistical Inference for Contextual Bandits via Stochastic Gradient Descent
by: Chang, Xiangyu, et al.
Published: (2022)

Towards Continuous-Time Approximations for Stochastic Gradient Descent without Replacement
by: Perko, Stefan
Published: (2025)

Local Gradient Regulation Stabilizes Federated Learning under Client Heterogeneity
by: Luo, Ping, et al.
Published: (2026)

Stochastic Smoothed Gradient Descent Ascent for Federated Minimax Optimization
by: Shen, Wei, et al.
Published: (2023)

Trustworthiness of Stochastic Gradient Descent in Distributed Learning
by: Li, Hongyang, et al.
Published: (2024)

A Unified Analysis for Finite Weight Averaging
by: Wang, Peng, et al.
Published: (2024)

Tight Generalization Error Bounds for Stochastic Gradient Descent in Non-convex Learning
by: Xiong, Wenjun, et al.
Published: (2025)

Adjacent Leader Decentralized Stochastic Gradient Descent
by: He, Haoze, et al.
Published: (2024)

A Bootstrap Perspective on Stochastic Gradient Descent
by: Lan, Hongjian, et al.
Published: (2025)

Stochastic Gradient Descent for Nonparametric Additive Regression
by: Chen, Xin, et al.
Published: (2024)

Bolstering Stochastic Gradient Descent with Model Building
by: Birbil, S. Ilker, et al.
Published: (2021)

Descend or Rewind? Stochastic Gradient Descent Unlearning
by: Mu, Siqiao, et al.
Published: (2025)

Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent
by: Vaswani, Sharan, et al.
Published: (2021)