Cover Image

On Provable Benefits of Muon in Federated Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Xinwen, Gao, Hongchang
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Federated Stochastic Minimax Optimization under Heavy-Tailed Noises
by: Zhang, Xinwen, et al.
Published: (2025)

Federated Compositional Deep AUC Maximization
by: Zhang, Xinwen, et al.
Published: (2023)

Momentum Benefits Non-IID Federated Learning Simply and Provably
by: Cheng, Ziheng, et al.
Published: (2023)

Decentralized Multi-Level Compositional Optimization Algorithms with Level-Independent Convergence Rate
by: Gao, Hongchang
Published: (2023)

Decentralized Stochastic Gradient Descent Ascent for Finite-Sum Minimax Problems
by: Gao, Hongchang
Published: (2022)

Learning to Reason with Curriculum I: Provable Benefits of Autocurriculum
by: Rajaraman, Nived, et al.
Published: (2026)

Muon is Provably Faster with Momentum Variance Reduction
by: Qian, Xun, et al.
Published: (2025)

Provable Mutual Benefits from Federated Learning in Privacy-Sensitive Domains
by: Tsoy, Nikita, et al.
Published: (2024)

AMOSL: Adaptive Modality-wise Structure Learning in Multi-view Graph Neural Networks For Enhanced Unified Representation
by: Liang, Peiyu, et al.
Published: (2024)

Provable Benefits of In-Tool Learning for Large Language Models
by: Houliston, Sam, et al.
Published: (2025)

Provable Benefit of Cutout and CutMix for Feature Learning
by: Oh, Junsoo, et al.
Published: (2024)

Provable Benefits of Sinusoidal Activation for Modular Addition
by: Huang, Tianlong, et al.
Published: (2025)

Preconditioning Benefits of Spectral Orthogonalization in Muon
by: Ma, Jianhao, et al.
Published: (2026)

Provable Benefit of Curriculum in Transformer Tree-Reasoning Post-Training
by: Bu, Dake, et al.
Published: (2025)

Provably Convergent Federated Trilevel Learning
by: Jiao, Yang, et al.
Published: (2023)

Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models
by: Jones-McCormick, Taj, et al.
Published: (2025)

FedMuon: Accelerating Federated Learning with Matrix Orthogonalization
by: Liu, Junkang, et al.
Published: (2025)

How Muon's Spectral Design Benefits Generalization: A Study on Imbalanced Data
by: Vasudeva, Bhavya, et al.
Published: (2025)

Provable Long-Range Benefits of Next-Token Prediction
by: Cao, Xinyuan, et al.
Published: (2025)

Semi-Supervised Sparse Gaussian Classification: Provable Benefits of Unlabeled Data
by: Azar, Eyar, et al.
Published: (2024)

AdaMuon: Adaptive Muon Optimizer
by: Si, Chongjie, et al.
Published: (2025)

FedFACT: A Provable Framework for Controllable Group-Fairness Calibration in Federated Learning
by: Zhang, Li, et al.
Published: (2025)

Compression of Structured Data with Autoencoders: Provable Benefit of Nonlinearities and Depth
by: Kögler, Kevin, et al.
Published: (2024)

FedMuon: Federated Learning with Bias-corrected LMO-based Optimization
by: Takezawa, Yuki, et al.
Published: (2025)

Muon-OGD: Muon-based Spectral Orthogonal Gradient Projection for LLM Continual Learning
by: Lu, Binghang, et al.
Published: (2026)

Provably Robust Federated Reinforcement Learning
by: Fang, Minghong, et al.
Published: (2025)

Unsupervised Data Generation for Offline Reinforcement Learning: A Perspective from Model
by: He, Shuncheng, et al.
Published: (2025)

Provably Communication-Efficient and Privacy-Preserving Federated Graph Neural Networks
by: Guo, Zhishuai, et al.
Published: (2026)

Provable Reduction in Communication Rounds for Non-Smooth Convex Federated Learning
by: Palenzuela, Karlo, et al.
Published: (2025)

Metastable Dynamics of Chain-of-Thought Reasoning: Provable Benefits of Search, RL and Distillation
by: Kim, Juno, et al.
Published: (2025)

A Hierarchical Language Model with Predictable Scaling Laws and Provable Benefits of Reasoning
by: Gaitonde, Jason, et al.
Published: (2026)

Provable Training for Graph Contrastive Learning
by: Yu, Yue, et al.
Published: (2023)

MuonQ: Enhancing Low-Bit Muon Quantization via Directional Fidelity Optimization
by: Su, Yupeng, et al.
Published: (2026)

Gradient-Free Method for Heavily Constrained Nonconvex Optimization
by: Shi, Wanli, et al.
Published: (2024)

Blockchain-empowered Federated Learning: Benefits, Challenges, and Solutions
by: Cai, Zeju, et al.
Published: (2024)

FedThief: Harming Others to Benefit Oneself in Self-Centered Federated Learning
by: Zhang, Xiangyu, et al.
Published: (2025)

SIFU: Sequential Informed Federated Unlearning for Efficient and Provable Client Unlearning in Federated Optimization
by: Fraboni, Yann, et al.
Published: (2022)

Muon with Spectral Guidance: Efficient Optimization for Scientific Machine Learning
by: Lu, Binghang, et al.
Published: (2026)

Provably Near-Optimal Federated Ensemble Distillation with Negligible Overhead
by: Jang, Won-Jun, et al.
Published: (2025)

Towards Provable Emergence of In-Context Reinforcement Learning
by: Wang, Jiuqi, et al.
Published: (2025)