Image de couverture de livre

Adjacent Leader Decentralized Stochastic Gradient Descent

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	He, Haoze, Wang, Jing, Choromanska, Anna
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

A Survey of Optimization Methods for Training DL Models: Theoretical Perspective on Convergence and Generalization
par: Wang, Jing, et autres
Publié: (2025)

GRAWA: Gradient-based Weighted Averaging for Distributed Training of Deep Learning Models
par: Dimlioglu, Tolga, et autres
Publié: (2024)

Decentralized Stochastic Gradient Descent Ascent for Finite-Sum Minimax Problems
par: Gao, Hongchang
Publié: (2022)

Stochastic Gradient Descent with Adaptive Data
par: Che, Ethan, et autres
Publié: (2024)

Task-Level Contrastiveness for Cross-Domain Few-Shot Learning
par: Topollai, Kristi, et autres
Publié: (2025)

Understanding Quantization of Optimizer States in LLM Pre-training: Dynamics of State Staleness and Effectiveness of State Resets
par: Topollai, Kristi, et autres
Publié: (2026)

Adaptive Memory Momentum via a Model-Based Framework for Deep Learning Optimization
par: Topollai, Kristi, et autres
Publié: (2025)

Variational Stochastic Gradient Descent for Deep Neural Networks
par: Chen, Haotian, et autres
Publié: (2024)

Generalization Bounds of Stochastic Gradient Descent in Homogeneous Neural Networks
par: Ma, Wenquan, et autres
Publié: (2026)

Stochastic Adaptive Gradient Descent Without Descent
par: Aujol, Jean-François, et autres
Publié: (2025)

On the Generalization of Stochastic Gradient Descent with Momentum
par: Ramezani-Kebrya, Ali, et autres
Publié: (2018)

Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning
par: Dimlioglu, Tolga, et autres
Publié: (2025)

Stochastic Gradient Descent with Momentum is Algorithmically Stable
par: Lei, Yunwen, et autres
Publié: (2026)

Stochastic Gradient Descent for Nonparametric Additive Regression
par: Chen, Xin, et autres
Publié: (2024)

A Bootstrap Perspective on Stochastic Gradient Descent
par: Lan, Hongjian, et autres
Publié: (2025)

Bolstering Stochastic Gradient Descent with Model Building
par: Birbil, S. Ilker, et autres
Publié: (2021)

Descend or Rewind? Stochastic Gradient Descent Unlearning
par: Mu, Siqiao, et autres
Publié: (2025)

A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent
par: Wang, Mingze, et autres
Publié: (2023)

Cheap Bootstrap for Fast Uncertainty Quantification of Stochastic Gradient Descent
par: Lam, Henry, et autres
Publié: (2023)

Stochastic Gradient Descent with Strategic Querying
par: Jiang, Nanfei, et autres
Publié: (2025)

Online Statistical Inference for Contextual Bandits via Stochastic Gradient Descent
par: Chang, Xiangyu, et autres
Publié: (2022)

Stochastic Gradient Descent for Two-layer Neural Networks
par: Cao, Dinghao, et autres
Publié: (2024)

Towards Learning Stochastic Population Models by Gradient Descent
par: Kreikemeyer, Justin N., et autres
Publié: (2024)

Personalized Federated Learning with Exact Stochastic Gradient Descent
par: Nikoloutsopoulos, Sotirios, et autres
Publié: (2022)

Stochastic Gradient Descent for Gaussian Processes Done Right
par: Lin, Jihao Andreas, et autres
Publié: (2023)

Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent
par: Deng, Xiaoge, et autres
Publié: (2023)

Learning Curves of Stochastic Gradient Descent in Kernel Regression
par: Zhang, Haihan, et autres
Publié: (2025)

Statistical Guarantees for High-Dimensional Stochastic Gradient Descent
par: Li, Jiaqi, et autres
Publié: (2025)

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
par: Ziyin, Liu, et autres
Publié: (2024)

RESIST: Resilient Decentralized Learning Using Consensus Gradient Descent
par: Fang, Cheng, et autres
Publié: (2025)

Non-Coherent Over-the-Air Decentralized Gradient Descent
par: Michelusi, Nicolo'
Publié: (2022)

Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent
par: Sato, Naoki, et autres
Publié: (2024)

Derivatives of Stochastic Gradient Descent in parametric optimization
par: Iutzeler, Franck, et autres
Publié: (2024)

Adaptive Heavy-Tailed Stochastic Gradient Descent
par: Gong, Bodu, et autres
Publié: (2025)

Streaming Krylov-Accelerated Stochastic Gradient Descent
par: Thomas, Stephen
Publié: (2025)

Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent
par: Schertzer, Adrien, et autres
Publié: (2024)

On the different regimes of Stochastic Gradient Descent
par: Sclocchi, Antonio, et autres
Publié: (2023)

Limit Theorems for Stochastic Gradient Descent with Infinite Variance
par: Blanchet, Jose, et autres
Publié: (2024)

Worker Disagreement Reveals Sharp Directions in Local SGD
par: Dimlioglu, Tolga, et autres
Publié: (2026)

Statistical Inference for Differentially Private Stochastic Gradient Descent
par: Xia, Xintao, et autres
Publié: (2025)