Image de couverture de livre

FedMuon: Federated Learning with Bias-corrected LMO-based Optimization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Takezawa, Yuki, Koloskova, Anastasia, Jiang, Xiaowen, Stich, Sebastian U.
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Exploiting Similarity for Computation and Communication-Efficient Decentralized Optimization
par: Takezawa, Yuki, et autres
Publié: (2025)

Scalable Decentralized Learning with Teleportation
par: Takezawa, Yuki, et autres
Publié: (2025)

Federated Optimization with Doubly Regularized Drift Correction
par: Jiang, Xiaowen, et autres
Publié: (2024)

Stabilized Proximal-Point Methods for Federated Optimization
par: Jiang, Xiaowen, et autres
Publié: (2024)

On Convergence of Incremental Gradient for Non-Convex Smooth Functions
par: Koloskova, Anastasia, et autres
Publié: (2023)

Non-Convex Federated Optimization under Cost-Aware Client Selection
par: Jiang, Xiaowen, et autres
Publié: (2025)

Locally Adaptive Federated Learning
par: Mukherjee, Sohom, et autres
Publié: (2023)

Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)
par: Riabinin, Artem, et autres
Publié: (2025)

Delayed Momentum Aggregation: Communication-efficient Byzantine-robust Federated Learning with Partial Participation
par: Otsuka, Kaoru, et autres
Publié: (2025)

Non-convex Stochastic Composite Optimization with Polyak Momentum
par: Gao, Yuan, et autres
Publié: (2024)

Accelerated Distributed Optimization with Compression and Error Feedback
par: Gao, Yuan, et autres
Publié: (2025)

Towards Faster Decentralized Stochastic Optimization with Communication Compression
par: Islamov, Rustem, et autres
Publié: (2024)

Avoiding Bias in Clipped SGD for Overparameterized Models under Generalized Smoothness
par: Lobanov, Aleksandr, et autres
Publié: (2026)

Better LMO-based Momentum Methods with Second-Order Information
par: Khirirat, Sarit, et autres
Publié: (2025)

FedMuon: Accelerating Federated Learning with Matrix Orthogonalization
par: Liu, Junkang, et autres
Publié: (2025)

Composite Optimization with Error Feedback: the Dual Averaging Approach
par: Gao, Yuan, et autres
Publié: (2025)

Local LMO: Constrained Gradient Optimization via a Local Linear Minimization Oracle
par: Richtárik, Peter, et autres
Publié: (2026)

Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates
par: Zhang, Siqi, et autres
Publié: (2023)

Universality of AdaGrad Stepsizes for Stochastic Optimization: Inexact Oracle, Acceleration and Variance Reduction
par: Rodomanov, Anton, et autres
Publié: (2024)

Parameter-free Clipped Gradient Descent Meets Polyak
par: Takezawa, Yuki, et autres
Publié: (2024)

LiMuon: Light and Fast Muon Optimizer for Large Models
par: Huang, Feihu, et autres
Publié: (2025)

Implicit Bias of Spectral Descent and Muon on Multiclass Separable Data
par: Fan, Chen, et autres
Publié: (2025)

DADA: Dual Averaging with Distance Adaptation
par: Moshtaghifar, Mohammad, et autres
Publié: (2025)

Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum
par: Cai, Haoyuan, et autres
Publié: (2024)

FedGiA: An Efficient Hybrid Algorithm for Federated Learning
par: Zhou, Shenglong, et autres
Publié: (2022)

FedSEA: Achieving Benefit of Parallelization in Federated Online Learning
par: Sahu, Harekrushna, et autres
Publié: (2026)

Improved Convergence Rates of Muon Optimizer for Nonconvex Optimization
par: Nagashima, Shuntaro, et autres
Publié: (2026)

Muon Optimizes Under Spectral Norm Constraints
par: Chen, Lizhang, et autres
Publié: (2025)

FedCluster: Boosting the Convergence of Federated Learning via Cluster-Cycling
par: Chen, Cheng, et autres
Publié: (2020)

Lions and Muons: Optimization via Stochastic Frank-Wolfe
par: Sfyraki, Maria-Eleni, et autres
Publié: (2025)

The Newton-Muon Optimizer
par: Du, Zhehang, et autres
Publié: (2026)

The Privacy Power of Correlated Noise in Decentralized Learning
par: Allouah, Youssef, et autres
Publié: (2024)

FedSGM: A Unified Framework for Constraint Aware, Bidirectionally Compressed, Multi-Step Federated Optimization
par: Upadhyay, Antesh, et autres
Publié: (2026)

Phases of Muon: When Muon Eclipses SignSGD
par: Paquette, Elliot, et autres
Publié: (2026)

FedSUM Family: Efficient Federated Learning Methods under Arbitrary Client Participation
par: You, Runze, et autres
Publié: (2025)

Revisiting LocalSGD and SCAFFOLD: Improved Rates and Missing Analysis
par: Luo, Ruichen, et autres
Publié: (2025)

MuonBP: Faster Muon via Block-Periodic Orthogonalization
par: Khaled, Ahmed, et autres
Publié: (2025)

MiMuon: Mixed Muon Optimizer with Improved Generalization for Large Models
par: Huang, Feihu, et autres
Publié: (2026)

Optimizer-Induced Mode Connectivity: From AdamW to Muon
par: Zhang, Fangzhao, et autres
Publié: (2026)

Ringmaster LMO: Asynchronous Linear Minimization Oracle Momentum Method
par: Sadiev, Abdurakhmon, et autres
Publié: (2026)