Image de couverture de livre

Low-Communication Resilient Distributed Estimation Algorithm Based on Memory Mechanism

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Wei, Hu, Limei, Chen, Feng, Yao, Ye
Format:	Preprint
Publié:	2025
Sujets:	Distributed, Parallel, and Cluster Computing Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Communication Optimization for Distributed Training: Architecture, Advances, and Opportunities
par: Wei, Yunze, et autres
Publié: (2024)

OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
par: Jaghouar, Sami, et autres
Publié: (2024)

Communication-Efficient Distributed Learning with Local Immediate Error Compensation
par: Cheng, Yifei, et autres
Publié: (2024)

An All-Reduce Compatible Top-K Compressor for Communication-Efficient Distributed Learning
par: Chen, Chuyan, et autres
Publié: (2025)

Echo: Simulating Distributed Training At Scale
par: Feng, Yicheng, et autres
Publié: (2024)

Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework
par: Yu, Siyuan, et autres
Publié: (2024)

Generalization Error Analysis for Attack-Free and Byzantine-Resilient Decentralized Learning with Data Heterogeneity
par: Ye, Haoxiang, et autres
Publié: (2025)

The Panaceas for Improving Low-Rank Decomposition in Communication-Efficient Federated Learning
par: Li, Shiwei, et autres
Publié: (2025)

FedSR: A Semi-Decentralized Federated Learning Algorithm for Non-IIDness in IoT System
par: Huang, Jianjun, et autres
Publié: (2024)

Scalable Decentralized Algorithms for Online Personalized Mean Estimation
par: Galante, Franco, et autres
Publié: (2024)

SparDL: Distributed Deep Learning Training with Efficient Sparse Communication
par: Zhao, Minjun, et autres
Publié: (2023)

NEST: Network- and Memory-Aware Device Placement For Distributed Deep Learning
par: Wang, Irene, et autres
Publié: (2026)

Relay Buffer Independent Communication over Pooled HBM for Efficient MoE Inference on Ascend
par: Hu, Tianlun, et autres
Publié: (2026)

Reducing Communication for Split Learning by Randomized Top-k Sparsification
par: Zheng, Fei, et autres
Publié: (2023)

Byzantine-Robust and Communication-Efficient Distributed Learning via Compressed Momentum Filtering
par: Liu, Changxin, et autres
Publié: (2024)

Distributed Graph Embedding with Information-Oriented Random Walks
par: Fang, Peng, et autres
Publié: (2023)

Armada: Memory-Efficient Distributed Training of Large-Scale Graph Neural Networks
par: Waleffe, Roger, et autres
Publié: (2025)

Accelerating Wireless Distributed Learning via Hybrid Split and Federated Learning Optimization
par: Guo, Kun, et autres
Publié: (2025)

Efficient Data Distribution Estimation for Accelerated Federated Learning
par: Wang, Yuanli, et autres
Publié: (2024)

Near-Optimal Resilient Aggregation Rules for Distributed Learning Using 1-Center and 1-Mean Clustering with Outliers
par: Yi, Yuhao, et autres
Publié: (2023)

FedGAT: A Privacy-Preserving Federated Approximation Algorithm for Graph Attention Networks
par: Ambekar, Siddharth, et autres
Publié: (2024)

Communication-Efficient Federated Group Distributionally Robust Optimization
par: Guo, Zhishuai, et autres
Publié: (2024)

SignMuon: Communication-Efficient Distributed Muon Optimization
par: Mishra, Neel, et autres
Publié: (2026)

Lion Cub: Minimizing Communication Overhead in Distributed Lion
par: Ishikawa, Satoki, et autres
Publié: (2024)

Accelerating Large Language Model Training with 4D Parallelism and Memory Consumption Estimator
par: Fujii, Kazuki, et autres
Publié: (2024)

ChunkFlow: Communication-Aware Chunked Prefetching for Layerwise Offloading in Distributed Diffusion Transformer Inference
par: Meng, Han, et autres
Publié: (2026)

TACOS: Topology-Aware Collective Algorithm Synthesizer for Distributed Machine Learning
par: Won, William, et autres
Publié: (2023)

AI-Driven Health Monitoring of Distributed Computing Architecture: Insights from XGBoost and SHAP
par: Sun, Xiaoxuan, et autres
Publié: (2024)

DiffKV: Differentiated Memory Management for Large Language Models with Parallel KV Compaction
par: Zhang, Yanqi, et autres
Publié: (2024)

Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression
par: He, Yutong, et autres
Publié: (2023)

Locally Estimated Global Perturbations are Better than Local Perturbations for Federated Sharpness-aware Minimization
par: Fan, Ziqing, et autres
Publié: (2024)

EarthSight: A Distributed Framework for Low-Latency Satellite Intelligence
par: Erol, Ansel Kaplan, et autres
Publié: (2025)

Lazarus: Resilient and Elastic Training of Mixture-of-Experts Models
par: Wu, Yongji, et autres
Publié: (2024)

Sketched Gaussian Mechanism for Private Federated Learning
par: Li, Qiaobo, et autres
Publié: (2025)

Straggler-Resilient Decentralized Learning via Adaptive Asynchronous Updates
par: Xiong, Guojun, et autres
Publié: (2023)

AutoRank: MCDA Based Rank Personalization for LoRA-Enabled Distributed Learning
par: Chen, Shuaijun, et autres
Publié: (2024)

TokenWeave: Efficient Compute-Communication Overlap for Distributed LLM Inference
par: Gond, Raja, et autres
Publié: (2025)

Communication-Efficient Distributed Deep Learning via Federated Dynamic Averaging
par: Theologitis, Michail, et autres
Publié: (2024)

Detection of Global Anomalies on Distributed IoT Edges with Device-to-Device Communication
par: Ochiai, Hideya, et autres
Publié: (2024)

Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning
par: Dimlioglu, Tolga, et autres
Publié: (2025)