Imagen de Portada

FedMuon: Accelerating Federated Learning with Matrix Orthogonalization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Junkang, Shang, Fanhua, Zhou, Junchao, Liu, Hongying, Liu, Yuanyuan, Liu, Jin
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

FedNSAM:Consistency of Local and Global Flatness for Federated Learning
por: Liu, Junkang, et al.
Publicado: (2026)

DP-FedPGN: Finding Global Flat Minima for Differentially Private Federated Learning via Penalizing Gradient Norm
por: Liu, Junkang, et al.
Publicado: (2025)

FedBCD:Communication-Efficient Accelerated Block Coordinate Gradient Descent for Federated Learning
por: Liu, Junkang, et al.
Publicado: (2026)

Taming Preconditioner Drift: Unlocking the Potential of Second-Order Optimizers for Federated Learning on Non-IID Data
por: Liu, Junkang, et al.
Publicado: (2026)

FedAdamW: A Communication-Efficient Optimizer with Convergence and Generalization Guarantees for Federated Large Models
por: Liu, Junkang, et al.
Publicado: (2025)

FedSWA: Improving Generalization in Federated Learning with Highly Heterogeneous Data via Momentum-Based Stochastic Controlled Weight Averaging
por: junkang, Liu, et al.
Publicado: (2025)

ILoRA: Federated Learning with Low-Rank Adaptation for Heterogeneous Client Aggregation
por: Zhou, Junchao, et al.
Publicado: (2025)

DP-FedAdamW: An Efficient Optimizer for Differentially Private Federated Large Models
por: Liu, Jin, et al.
Publicado: (2026)

Rethinking LoRA for Privacy-Preserving Federated Learning in Large Models
por: Liu, Jin, et al.
Publicado: (2026)

FedMuon: Federated Learning with Bias-corrected LMO-based Optimization
por: Takezawa, Yuki, et al.
Publicado: (2025)

FedSVD: Adaptive Orthogonalization for Private Federated Learning with LoRA
por: Lee, Seanie, et al.
Publicado: (2025)

FedMP: Tackling Medical Feature Heterogeneity in Federated Learning from a Manifold Perspective
por: Zhou, Zhekai, et al.
Publicado: (2025)

FedLPA: One-shot Federated Learning with Layer-Wise Posterior Aggregation
por: Liu, Xiang, et al.
Publicado: (2023)

CEPerFed: Communication-Efficient Personalized Federated Learning for Multi-Pulse MRI Classification
por: Li, Ludi, et al.
Publicado: (2025)

Towards stable training of parallel continual learning
por: Yuepan, Li, et al.
Publicado: (2024)

Federated Knowledge Graph Unlearning via Diffusion Model
por: Liu, Bingchen, et al.
Publicado: (2024)

DRAGD: A Federated Unlearning Data Reconstruction Attack Based on Gradient Differences
por: Ju, Bocheng, et al.
Publicado: (2025)

FedMobile: Enabling Knowledge Contribution-aware Multi-modal Federated Learning with Incomplete Modalities
por: Liu, Yi, et al.
Publicado: (2025)

FedFixer: Mitigating Heterogeneous Label Noise in Federated Learning
por: Ji, Xinyuan, et al.
Publicado: (2024)

FedSDR: Federated Self-Distillation with Rectification
por: Ren, Ziheng, et al.
Publicado: (2026)

FedRS-Bench: Realistic Federated Learning Datasets and Benchmarks in Remote Sensing
por: Zhao, Haodong, et al.
Publicado: (2025)

FedConv: A Learning-on-Model Paradigm for Heterogeneous Federated Clients
por: Shen, Leming, et al.
Publicado: (2025)

FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning
por: Lee, Gihun, et al.
Publicado: (2023)

FedConPE: Efficient Federated Conversational Bandits with Heterogeneous Clients
por: Li, Zhuohua, et al.
Publicado: (2024)

Preconditioning Benefits of Spectral Orthogonalization in Muon
por: Ma, Jianhao, et al.
Publicado: (2026)

FedSI: Federated Subnetwork Inference for Efficient Uncertainty Quantification
por: Chen, Hui, et al.
Publicado: (2024)

FedPaI: Achieving Extreme Sparsity in Federated Learning via Pruning at Initialization
por: Wang, Haonan, et al.
Publicado: (2025)

FedLoGe: Joint Local and Generic Federated Learning under Long-tailed Data
por: Xiao, Zikai, et al.
Publicado: (2024)

Spectral Flattening Is All Muon Needs: How Orthogonalization Controls Learning Rate and Convergence
por: Nguyen, Tien-Phat, et al.
Publicado: (2026)

FedAFD: Multimodal Federated Learning via Adversarial Fusion and Distillation
por: Tan, Min, et al.
Publicado: (2026)

AutoFed: Personalized Federated Traffic Prediction via Adaptive Prompt
por: Zhao, Zijian, et al.
Publicado: (2025)

Scalable Heterogeneous Graph Learning via Heterogeneous-aware Orthogonal Prototype Experts
por: Zhou, Wei, et al.
Publicado: (2026)

TrasMuon: Trust-Region Adaptive Scaling for Orthogonalized Momentum Optimizers
por: Cheng, Peng, et al.
Publicado: (2026)

Muon$^2$: Boosting Muon via Adaptive Second-Moment Preconditioning
por: Liu, Ziyue, et al.
Publicado: (2026)

Intrinsic Muon: Spectral Optimization on Riemannian Matrix Manifolds
por: Li, Yibang, et al.
Publicado: (2026)

FedEFC: Federated Learning Using Enhanced Forward Correction Against Noisy Labels
por: Yu, Seunghun, et al.
Publicado: (2025)

FedTrans: Efficient Federated Learning via Multi-Model Transformation
por: Zhu, Yuxuan, et al.
Publicado: (2024)

FedUV: Uniformity and Variance for Heterogeneous Federated Learning
por: Son, Ha Min, et al.
Publicado: (2024)

Elastic Multi-Gradient Descent for Parallel Continual Learning
por: Lyu, Fan, et al.
Publicado: (2024)

FedRio: Personalized Federated Social Bot Detection via Cooperative Reinforced Contrastive Adversarial Distillation
por: Yang, Yingguang, et al.
Publicado: (2026)