Image de couverture de livre

Tight analyses of first-order methods with error feedback

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Thomsen, Daniel Berg, Taylor, Adrien, Dieuleveut, Aymeric
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Distributed, Parallel, and Cluster Computing Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

A Tight Theory of Error Feedback Algorithms in Distributed Optimization
par: Thomsen, Daniel Berg, et autres
Publié: (2026)

FedCanon: Non-Convex Composite Federated Learning with Efficient Proximal Operation on Heterogeneous Data
par: Zhou, Yuan, et autres
Publié: (2025)

Ringmaster ASGD: The First Asynchronous SGD with Optimal Time Complexity
par: Maranjyan, Artavazd, et autres
Publié: (2025)

Time-varying Mixing Matrix Design for Energy-efficient Decentralized Federated Learning
par: Zhang, Xusheng, et autres
Publié: (2025)

Continuous-Time Analysis of Federated Averaging
par: Overman, Tom, et autres
Publié: (2025)

Revisiting LocalSGD and SCAFFOLD: Improved Rates and Missing Analysis
par: Luo, Ruichen, et autres
Publié: (2025)

Ringleader ASGD: The First Asynchronous SGD with Optimal Time Complexity under Data Heterogeneity
par: Maranjyan, Artavazd, et autres
Publié: (2025)

A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration
par: Hu, Yuchen, et autres
Publié: (2025)

A Survey of Optimization Methods for Training DL Models: Theoretical Perspective on Convergence and Generalization
par: Wang, Jing, et autres
Publié: (2025)

Proving the Limited Scalability of Centralized Distributed Optimization via a New Lower Bound Construction
par: Tyurin, Alexander
Publié: (2025)

ATA: Adaptive Task Allocation for Efficient Resource Management in Distributed Machine Learning
par: Maranjyan, Artavazd, et autres
Publié: (2025)

Provable Model-Parallel Distributed Principal Component Analysis with Parallel Deflation
par: Liao, Fangshuo, et autres
Publié: (2025)

Asynchronous Policy Gradient Aggregation for Efficient Distributed Reinforcement Learning
par: Tyurin, Alexander, et autres
Publié: (2025)

Birch SGD: A Tree Graph Framework for Local and Asynchronous SGD Methods
par: Tyurin, Alexander, et autres
Publié: (2025)

Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum
par: Zhou, Yuan, et autres
Publié: (2025)

A Hybrid Stochastic Gradient Tracking Method for Distributed Online Optimization Over Time-Varying Directed Networks
par: Shi, Xinli, et autres
Publié: (2025)

On Principled Local Optimization Methods for Federated Learning
par: Yuan, Honglin
Publié: (2024)

Ringmaster LMO: Asynchronous Linear Minimization Oracle Momentum Method
par: Sadiev, Abdurakhmon, et autres
Publié: (2026)

Decentralized Directed Collaboration for Personalized Federated Learning
par: Liu, Yingqi, et autres
Publié: (2024)

Stochastic Controlled Averaging for Federated Learning with Communication Compression
par: Huang, Xinmeng, et autres
Publié: (2023)

High-Performance Hybrid Algorithm for Minimum Sum-of-Squares Clustering of Infinitely Tall Data
par: Mussabayev, Ravil, et autres
Publié: (2023)

Decentralized Personalized Federated Learning for Min-Max Problems
par: Borodich, Ekaterina, et autres
Publié: (2021)

GradSkip: Communication-Accelerated Local Gradient Methods with Better Computational Complexity
par: Maranjyan, Artavazd, et autres
Publié: (2022)

A Stochastic Approximation Approach for Efficient Decentralized Optimization on Random Networks
par: Yau, Chung-Yiu, et autres
Publié: (2024)

Convergence of Sign-based Random Reshuffling Algorithms for Nonconvex Optimization
par: Qin, Zhen, et autres
Publié: (2023)

Accelerated Methods with Compressed Communications for Distributed Optimization Problems under Data Similarity
par: Bylinkin, Dmitry, et autres
Publié: (2024)

BROADCAST: Reducing Both Stochastic and Compression Noise to Robustify Communication-Efficient Federated Learning
par: Zhu, Heng, et autres
Publié: (2021)

Communication-Efficient Federated Bilevel Optimization with Local and Global Lower Level Problems
par: Li, Junyi, et autres
Publié: (2023)

The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication
par: Patel, Kumar Kshitij, et autres
Publié: (2024)

Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape
par: Sun, Yan, et autres
Publié: (2023)

Optimizing Stochastic Gradient Push under Broadcast Communications
par: Nguyen, Tuan, et autres
Publié: (2026)

Efficient Federated Learning against Heterogeneous and Non-stationary Client Unavailability
par: Xiang, Ming, et autres
Publié: (2024)

Rescaled Asynchronous SGD: Optimal Distributed Optimization under Data and System Heterogeneity
par: Mahran, Ammar, et autres
Publié: (2026)

Achieving Near-Optimal Convergence for Distributed Minimax Optimization with Adaptive Stepsizes
par: Huang, Yan, et autres
Publié: (2024)

Towards Dynamic Resource Allocation and Client Scheduling in Hierarchical Federated Learning: A Two-Phase Deep Reinforcement Learning Approach
par: Chen, Xiaojing, et autres
Publié: (2024)

Efficient Adaptive Federated Optimization
par: Lee, Su Hyeong, et autres
Publié: (2024)

Online Distributed Learning with Quantized Finite-Time Coordination
par: Bastianello, Nicola, et autres
Publié: (2023)

Accelerating Distributed Optimization: A Primal-Dual Perspective on Local Steps
par: Yang, Junchi, et autres
Publié: (2024)

Towards a Better Theoretical Understanding of Independent Subnetwork Training
par: Shulgin, Egor, et autres
Publié: (2023)

LoDAdaC: a unified local training-based decentralized framework with adaptive gradients and compressed communication
par: Liu, Wei, et autres
Publié: (2026)