Copertina

Distributed Learning based on 1-Bit Gradient Coding in the Presence of Stragglers

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Li, Chengxi, Skoglund, Mikael
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Biased Compression in Gradient Coding for Distributed Learning
di: Li, Chengxi, et al.
Pubblicazione: (2026)

Byzantine-Robust and Communication-Efficient Distributed Training: Compressive and Cyclic Gradient Coding
di: Li, Chengxi, et al.
Pubblicazione: (2026)

Cooperative Gradient Coding
di: Weng, Shudi, et al.
Pubblicazione: (2025)

General Coded Computing in a Probabilistic Straggler Regime
di: Moradi, Parsa, et al.
Pubblicazione: (2025)

Straggler-Resilient Decentralized Learning via Adaptive Asynchronous Updates
di: Xiong, Guojun, et al.
Pubblicazione: (2023)

Efficient AllReduce with Stragglers
di: Devraj, Arjun, et al.
Pubblicazione: (2025)

AntDT: A Self-Adaptive Distributed Training Framework for Leader and Straggler Nodes
di: Xiao, Youshao, et al.
Pubblicazione: (2024)

FedCore: Straggler-Free Federated Learning with Distributed Coresets
di: Guo, Hongpeng, et al.
Pubblicazione: (2024)

Stragglers Can Contribute More: Uncertainty-Aware Distillation for Asynchronous Federated Learning
di: Wang, Yujia, et al.
Pubblicazione: (2025)

Understanding Stragglers in Large Model Training Using What-if Analysis
di: Lin, Jinkun, et al.
Pubblicazione: (2025)

Temporal Predictive Coding for Gradient Compression in Distributed Learning
di: Edin, Adrian, et al.
Pubblicazione: (2024)

Towards Straggler-Resilient Split Federated Learning: An Unbalanced Update Approach
di: Liang, Dandan, et al.
Pubblicazione: (2025)

CoCoI: Distributed Coded Inference System for Straggler Mitigation
di: Liu, Xing, et al.
Pubblicazione: (2025)

Improved Quantization Strategies for Managing Heavy-tailed Gradients in Distributed Learning
di: Yan, Guangfeng, et al.
Pubblicazione: (2024)

Distributed Deep Learning using Stochastic Gradient Staleness
di: Pham, Viet Hoang, et al.
Pubblicazione: (2025)

FedBiF: Communication-Efficient Federated Learning via Bits Freezing
di: Li, Shiwei, et al.
Pubblicazione: (2025)

Federated Learning in the Presence of Adversarial Client Unavailability
di: Su, Lili, et al.
Pubblicazione: (2023)

Preserving Near-Optimal Gradient Sparsification Cost for Scalable Distributed Deep Learning
di: Yoon, Daegun, et al.
Pubblicazione: (2024)

Buffer-based Gradient Projection for Continual Federated Learning
di: Dai, Shenghong, et al.
Pubblicazione: (2024)

CLIP: Client-Side Invariant Pruning for Mitigating Stragglers in Secure Federated Learning
di: DiMaggio, Anthony, et al.
Pubblicazione: (2025)

Exploiting Stragglers in Distributed Computing Systems with Task Grouping
di: Adikari, Tharindu, et al.
Pubblicazione: (2024)

Understanding Server-Assisted Federated Learning in the Presence of Incomplete Client Participation
di: Yang, Haibo, et al.
Pubblicazione: (2024)

FedGCS: A Generative Framework for Efficient Client Selection in Federated Learning via Gradient-based Optimization
di: Ning, Zhiyuan, et al.
Pubblicazione: (2024)

Locally Differentially Private Online Federated Learning With Correlated Noise
di: Zhang, Jiaojiao, et al.
Pubblicazione: (2024)

Effectiveness of Distributed Gradient Descent with Local Steps for Overparameterized Models
di: Zhu, Heng, et al.
Pubblicazione: (2024)

Controlled disagreement improves generalization in decentralized training
di: Wang, Zesen, et al.
Pubblicazione: (2026)

dSTAR: Straggler Tolerant and Byzantine Resilient Distributed SGD
di: Yan, Jiahe, et al.
Pubblicazione: (2024)

Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients
di: Luo, Ping, et al.
Pubblicazione: (2024)

Nonconvex Federated Learning on Compact Smooth Submanifolds With Heterogeneous Data
di: Zhang, Jiaojiao, et al.
Pubblicazione: (2024)

Trustworthiness of Stochastic Gradient Descent in Distributed Learning
di: Li, Hongyang, et al.
Pubblicazione: (2024)

Guard: Scalable Straggler Detection and Node Health Management for Large-Scale Training
di: Liu, Guanliang, et al.
Pubblicazione: (2026)

Local Gradient Regulation Stabilizes Federated Learning under Client Heterogeneity
di: Luo, Ping, et al.
Pubblicazione: (2026)

FedQS: Optimizing Gradient and Model Aggregation for Semi-Asynchronous Federated Learning
di: Li, Yunbo, et al.
Pubblicazione: (2025)

Sparsity-Preserving Encodings for Straggler-Optimal Distributed Matrix Computations at the Edge
di: Das, Anindya Bijoy, et al.
Pubblicazione: (2024)

Asynch-SGBDT: Asynchronous Parallel Stochastic Gradient Boosting Decision Tree based on Parameters Server
di: Daning, Cheng, et al.
Pubblicazione: (2018)

Non-convex composite federated learning with heterogeneous data
di: Zhang, Jiaojiao, et al.
Pubblicazione: (2025)

Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework
di: Yu, Siyuan, et al.
Pubblicazione: (2024)

MiCRO: Near-Zero Cost Gradient Sparsification for Scaling and Accelerating Distributed DNN Training
di: Yoon, Daegun, et al.
Pubblicazione: (2023)

Robust Decentralized Learning with Local Updates and Gradient Tracking
di: Ghiasvand, Sajjad, et al.
Pubblicazione: (2024)

FedAgg: Adaptive Federated Learning with Aggregated Gradients
di: Yuan, Wenhao, et al.
Pubblicazione: (2023)