Copertina

SignMuon: Communication-Efficient Distributed Muon Optimization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Mishra, Neel, Trivedi, Kushagara, Kumar, Pawan
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Dion2: A Simple Method to Shrink Matrix in Muon
di: Ahn, Kwangjun, et al.
Pubblicazione: (2025)

Communication-Efficient Federated Group Distributionally Robust Optimization
di: Guo, Zhishuai, et al.
Pubblicazione: (2024)

Communication Optimization for Distributed Training: Architecture, Advances, and Opportunities
di: Wei, Yunze, et al.
Pubblicazione: (2024)

Federated Communication-Efficient Multi-Objective Optimization
di: Askin, Baris, et al.
Pubblicazione: (2024)

Communication-Efficient Distributed Learning with Local Immediate Error Compensation
di: Cheng, Yifei, et al.
Pubblicazione: (2024)

Communication-Efficient Distributed Deep Learning via Federated Dynamic Averaging
di: Theologitis, Michail, et al.
Pubblicazione: (2024)

TokenWeave: Efficient Compute-Communication Overlap for Distributed LLM Inference
di: Gond, Raja, et al.
Pubblicazione: (2025)

SparDL: Distributed Deep Learning Training with Efficient Sparse Communication
di: Zhao, Minjun, et al.
Pubblicazione: (2023)

Optimizing the Optimal Weighted Average: Efficient Distributed Sparse Classification
di: Lu, Fred, et al.
Pubblicazione: (2024)

An All-Reduce Compatible Top-K Compressor for Communication-Efficient Distributed Learning
di: Chen, Chuyan, et al.
Pubblicazione: (2025)

Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning
di: Dimlioglu, Tolga, et al.
Pubblicazione: (2025)

Byzantine-Robust and Communication-Efficient Distributed Learning via Compressed Momentum Filtering
di: Liu, Changxin, et al.
Pubblicazione: (2024)

High-Dimensional Distributed Sparse Classification with Scalable Communication-Efficient Global Updates
di: Lu, Fred, et al.
Pubblicazione: (2024)

Communication-Efficient Device Scheduling for Federated Learning Using Lyapunov Optimization
di: Perazzone, Jake B., et al.
Pubblicazione: (2025)

Communication and Energy Efficient Federated Learning using Zero-Order Optimization Technique
di: Mhanna, Elissa, et al.
Pubblicazione: (2024)

On Optimizing the Communication of Model Parallelism
di: Zhuang, Yonghao, et al.
Pubblicazione: (2022)

Hierarchical Federated Learning with SignSGD: A Highly Communication-Efficient Approach
di: Kazemi, Amirreza, et al.
Pubblicazione: (2026)

Communication-Efficient Federated Fine-Tuning
di: Theologitis, Michael, et al.
Pubblicazione: (2025)

Communication Efficient and Provable Federated Unlearning
di: Tao, Youming, et al.
Pubblicazione: (2024)

Lion Cub: Minimizing Communication Overhead in Distributed Lion
di: Ishikawa, Satoki, et al.
Pubblicazione: (2024)

Spectral Sentinel: Scalable Byzantine-Robust Decentralized Federated Learning via Sketched Random Matrix Theory on Blockchain
di: Mishra, Animesh
Pubblicazione: (2025)

Preble: Efficient Distributed Prompt Scheduling for LLM Serving
di: Srivatsa, Vikranth, et al.
Pubblicazione: (2024)

Efficient Data Distribution Estimation for Accelerated Federated Learning
di: Wang, Yuanli, et al.
Pubblicazione: (2024)

Masked Random Noise for Communication Efficient Federated Learning
di: Li, Shiwei, et al.
Pubblicazione: (2024)

Low-Communication Resilient Distributed Estimation Algorithm Based on Memory Mechanism
di: Li, Wei, et al.
Pubblicazione: (2025)

Detection of Global Anomalies on Distributed IoT Edges with Device-to-Device Communication
di: Ochiai, Hideya, et al.
Pubblicazione: (2024)

Efficient Parallelization Layouts for Large-Scale Distributed Model Training
di: Hagemann, Johannes, et al.
Pubblicazione: (2023)

Traversal Learning: A Lossless And Efficient Distributed Learning Framework
di: Batbaatar, Erdenebileg, et al.
Pubblicazione: (2025)

Learning to Shard: RL for Co-optimizing the Parallelism Degrees and Per-operator Sharding Dimensions in Distributed LLM Inference
di: Yin, Ruokai, et al.
Pubblicazione: (2025)

Communication-Efficient Federated AUC Maximization with Cyclic Client Participation
di: Vangapally, Umesh, et al.
Pubblicazione: (2026)

Communication and Computation Efficient Split Federated Learning in O-RAN
di: Gu, Shunxian, et al.
Pubblicazione: (2025)

Greedy Shapley Client Selection for Communication-Efficient Federated Learning
di: Singhal, Pranava, et al.
Pubblicazione: (2023)

DIGEST: Fast and Communication Efficient Decentralized Learning with Local Updates
di: Gholami, Peyman, et al.
Pubblicazione: (2023)

Ampere: Communication-Efficient and High-Accuracy Split Federated Learning
di: Zhang, Zihan, et al.
Pubblicazione: (2025)

Adaptive Client Selection with Personalization for Communication Efficient Federated Learning
di: de Souza, Allan M., et al.
Pubblicazione: (2024)

Optimizing Distributed Deployment of Mixture-of-Experts Model Inference in Serverless Computing
di: Liu, Mengfan, et al.
Pubblicazione: (2025)

BurstAttention: An Efficient Distributed Attention Framework for Extremely Long Sequences
di: Sun, Ao, et al.
Pubblicazione: (2024)

Hybrid Dual-Batch and Cyclic Progressive Learning for Efficient Distributed Training
di: Lu, Kuan-Wei, et al.
Pubblicazione: (2025)

FedBAT: Communication-Efficient Federated Learning via Learnable Binarization
di: Li, Shiwei, et al.
Pubblicazione: (2024)

Bandwidth-Aware and Overlap-Weighted Compression for Communication-Efficient Federated Learning
di: Tang, Zichen, et al.
Pubblicazione: (2024)