Copertina

A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Hu, Yuchen, Chen, Xi, Liu, Weidong, Mao, Xiaojun
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Distributed, Parallel, and Cluster Computing Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum
di: Zhou, Yuan, et al.
Pubblicazione: (2025)

Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression
di: He, Yutong, et al.
Pubblicazione: (2023)

A Stochastic Approximation Approach for Efficient Decentralized Optimization on Random Networks
di: Yau, Chung-Yiu, et al.
Pubblicazione: (2024)

A Single-Loop Algorithm for Decentralized Bilevel Optimization
di: Dong, Youran, et al.
Pubblicazione: (2023)

An Accelerated Distributed Stochastic Gradient Method with Momentum
di: Huang, Kun, et al.
Pubblicazione: (2024)

CEDAS: A Compressed Decentralized Stochastic Gradient Method with Improved Convergence
di: Huang, Kun, et al.
Pubblicazione: (2023)

S$^3$LDBO: A Snapshot Single-Loop Algorithm for Decentralized Bilevel Optimization
di: Yin, Chao, et al.
Pubblicazione: (2026)

Rennala MVR: Improved Time Complexity for Parallel Stochastic Optimization via Momentum-Based Variance Reduction
di: Tovmasyan, Zhirayr, et al.
Pubblicazione: (2026)

Optimizing Stochastic Gradient Push under Broadcast Communications
di: Nguyen, Tuan, et al.
Pubblicazione: (2026)

GradSkip: Communication-Accelerated Local Gradient Methods with Better Computational Complexity
di: Maranjyan, Artavazd, et al.
Pubblicazione: (2022)

A Double Tracking Method for Optimization with Decentralized Generalized Orthogonality Constraints
di: Wang, Lei, et al.
Pubblicazione: (2024)

A Hybrid Stochastic Gradient Tracking Method for Distributed Online Optimization Over Time-Varying Directed Networks
di: Shi, Xinli, et al.
Pubblicazione: (2025)

Decentralized Directed Collaboration for Personalized Federated Learning
di: Liu, Yingqi, et al.
Pubblicazione: (2024)

Decentralized Gradient-Free Methods for Stochastic Non-Smooth Non-Convex Optimization
di: Lin, Zhenwei, et al.
Pubblicazione: (2023)

Ringmaster LMO: Asynchronous Linear Minimization Oracle Momentum Method
di: Sadiev, Abdurakhmon, et al.
Pubblicazione: (2026)

A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming
di: Nazari, Parvin, et al.
Pubblicazione: (2022)

Decentralized Personalized Federated Learning for Min-Max Problems
di: Borodich, Ekaterina, et al.
Pubblicazione: (2021)

Energy-efficient Decentralized Learning via Graph Sparsification
di: Zhang, Xusheng, et al.
Pubblicazione: (2024)

Communication-Efficient Federated Optimization over Semi-Decentralized Networks
di: Wang, He, et al.
Pubblicazione: (2023)

Resource-Constrained Decentralized Federated Learning via Personalized Event-Triggering
di: Zehtabi, Shahryar, et al.
Pubblicazione: (2022)

Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization
di: Li, Jiaxiang, et al.
Pubblicazione: (2024)

Time-varying Mixing Matrix Design for Energy-efficient Decentralized Federated Learning
di: Zhang, Xusheng, et al.
Pubblicazione: (2025)

AGD: an Auto-switchable Optimizer using Stepwise Gradient Difference for Preconditioning Matrix
di: Yue, Yun, et al.
Pubblicazione: (2023)

CONGO: Compressive Online Gradient Optimization
di: Carleton, Jeremy, et al.
Pubblicazione: (2024)

Convergence of Sign-based Random Reshuffling Algorithms for Nonconvex Optimization
di: Qin, Zhen, et al.
Pubblicazione: (2023)

Activations and Gradients Compression for Model-Parallel Training
di: Rudakov, Mikhail, et al.
Pubblicazione: (2024)

Accelerating Distributed Optimization: A Primal-Dual Perspective on Local Steps
di: Yang, Junchi, et al.
Pubblicazione: (2024)

Stochastic Controlled Averaging for Federated Learning with Communication Compression
di: Huang, Xinmeng, et al.
Pubblicazione: (2023)

Asynchronous Policy Gradient Aggregation for Efficient Distributed Reinforcement Learning
di: Tyurin, Alexander, et al.
Pubblicazione: (2025)

GRAWA: Gradient-based Weighted Averaging for Distributed Training of Deep Learning Models
di: Dimlioglu, Tolga, et al.
Pubblicazione: (2024)

BROADCAST: Reducing Both Stochastic and Compression Noise to Robustify Communication-Efficient Federated Learning
di: Zhu, Heng, et al.
Pubblicazione: (2021)

Accelerated Methods with Compressed Communications for Distributed Optimization Problems under Data Similarity
di: Bylinkin, Dmitry, et al.
Pubblicazione: (2024)

Distributed Stochastic Momentum Tracking with Local Updates: Achieving Optimal Communication and Iteration Complexities
di: Huang, Kun, et al.
Pubblicazione: (2025)

LOSCAR-SGD: Local SGD with Communication-Computation Overlap and Delay-Corrected Sparse Model Averaging
di: Maziane, Yassine, et al.
Pubblicazione: (2026)

Distributed Saddle-Point Problems: Lower Bounds, Near-Optimal and Robust Algorithms
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2020)

High-Performance Hybrid Algorithm for Minimum Sum-of-Squares Clustering of Infinitely Tall Data
di: Mussabayev, Ravil, et al.
Pubblicazione: (2023)

Rendering Wireless Environments Useful for Gradient Estimators: A Zero-Order Stochastic Federated Learning Method
di: Mhanna, Elissa, et al.
Pubblicazione: (2024)

Smoothed Gradient Clipping and Error Feedback for Decentralized Optimization under Symmetric Heavy-Tailed Noise
di: Yu, Shuhua, et al.
Pubblicazione: (2023)

A Communication and Computation Efficient Fully First-order Method for Decentralized Bilevel Optimization
di: Wen, Min, et al.
Pubblicazione: (2024)

HiGrad: Uncertainty Quantification for Online Learning and Stochastic Approximation
di: Su, Weijie J., et al.
Pubblicazione: (2018)