Image de couverture de livre

Towards a Principled Muon under $μ\mathsf{P}$: Ensuring Spectral Conditions throughout Training

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Zhao, John
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Muon Optimizes Under Spectral Norm Constraints
par: Chen, Lizhang, et autres
Publié: (2025)

Implicit Bias of Spectral Descent and Muon on Multiclass Separable Data
par: Fan, Chen, et autres
Publié: (2025)

Muon Dynamics as a Spectral Wasserstein Flow
par: Peyré, Gabriel
Publié: (2026)

Preconditioning Benefits of Spectral Orthogonalization in Muon
par: Ma, Jianhao, et autres
Publié: (2026)

Muon in Associative Memory Learning: Training Dynamics and Scaling Laws
par: Li, Binghui, et autres
Publié: (2026)

Phases of Muon: When Muon Eclipses SignSGD
par: Paquette, Elliot, et autres
Publié: (2026)

MuonBP: Faster Muon via Block-Periodic Orthogonalization
par: Khaled, Ahmed, et autres
Publié: (2025)

LiMuon: Light and Fast Muon Optimizer for Large Models
par: Huang, Feihu, et autres
Publié: (2025)

Convergence of Muon with Newton-Schulz
par: Kim, Gyu Yeol, et autres
Publié: (2026)

Error Feedback for Muon and Friends
par: Gruntkowska, Kaja, et autres
Publié: (2025)

Muon Converges under Heavy-Tailed Noise: Nonconvex Hölder-Smooth Empirical Risk Minimization
par: Iiduka, Hideaki
Publié: (2026)

Global Convergence and Rich Feature Learning in $L$-Layer Infinite-Width Neural Networks under $μ$P Parametrization
par: Chen, Zixiang, et autres
Publié: (2025)

Insights on Muon from Simple Quadratics
par: Gonon, Antoine, et autres
Publié: (2026)

Muon Does Not Converge on Convex Lipschitz Functions
par: Parshakova, Tetiana, et autres
Publié: (2026)

Muon is Provably Faster with Momentum Variance Reduction
par: Qian, Xun, et autres
Publié: (2025)

Drop-Muon: Update Less, Converge Faster
par: Gruntkowska, Kaja, et autres
Publié: (2025)

Beyond the Ideal: Analyzing the Inexact Muon Update
par: Shulgin, Egor, et autres
Publié: (2025)

Beyond Muon: MUD (MomentUm Decorrelation) for Faster Transformer Training
par: Southworth, Ben S., et autres
Publié: (2026)

Improved Convergence Rates of Muon Optimizer for Nonconvex Optimization
par: Nagashima, Shuntaro, et autres
Publié: (2026)

Lions and Muons: Optimization via Stochastic Frank-Wolfe
par: Sfyraki, Maria-Eleni, et autres
Publié: (2025)

Implicit Regularization in Perturbed Deep Matrix Factorization: Spectral Conditions and Stability
par: Wang, Jingzhe, et autres
Publié: (2026)

AdaGrad Meets Muon: Adaptive Stepsizes for Orthogonal Updates
par: Zhang, Minxin, et autres
Publié: (2025)

MiMuon: Mixed Muon Optimizer with Improved Generalization for Large Models
par: Huang, Feihu, et autres
Publié: (2026)

FedMuon: Federated Learning with Bias-corrected LMO-based Optimization
par: Takezawa, Yuki, et autres
Publié: (2025)

The Newton-Muon Optimizer
par: Du, Zhehang, et autres
Publié: (2026)

On the Convergence Analysis of Muon
par: Shen, Wei, et autres
Publié: (2025)

Muon with Nesterov Momentum: Heavy-Tailed Noise and (Randomized) Inexact Polar Decomposition
par: Choudhury, Sayantan, et autres
Publié: (2026)

Leveraging Coordinate Momentum in SignSGD and Muon: Memory-Optimized Zero-Order
par: Petrov, Egor, et autres
Publié: (2025)

Model-Free $μ$-Synthesis: A Nonsmooth Optimization Perspective
par: Keivan, Darioush, et autres
Publié: (2024)

$μ^2$-SGD: Stable Stochastic Optimization via a Double Momentum Mechanism
par: Dahan, Tehila, et autres
Publié: (2023)

Faster Stochastic Algorithms for Minimax Optimization under Polyak--Łojasiewicz Conditions
par: Chen, Lesi, et autres
Publié: (2023)

On the Complexity of Finite-Sum Smooth Optimization under the Polyak-Łojasiewicz Condition
par: Bai, Yunyan, et autres
Publié: (2024)

Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)
par: Riabinin, Artem, et autres
Publié: (2025)

Towards an Optimal Control Perspective of ResNet Training
par: Püttschneider, Jens, et autres
Publié: (2025)

High-Probability Bounds for SGD under the Polyak-Lojasiewicz Condition with Markovian Noise
par: Kar, Avik, et autres
Publié: (2026)

Towards Guided Descent: Optimization Algorithms for Training Neural Networks At Scale
par: Nagwekar, Ansh
Publié: (2025)

DeMuon: A Decentralized Muon for Matrix Optimization over Graphs
par: He, Chuan, et autres
Publié: (2025)

Anytime Training with Schedule-Free Spectral Optimization
par: Apte, Anuj, et autres
Publié: (2026)

(Almost) Smooth Sailing: Towards Numerical Stability of Neural Networks Through Differentiable Regularization of the Condition Number
par: Nenov, Rossen, et autres
Publié: (2024)

Conditional simulation via entropic optimal transport: Toward non-parametric estimation of conditional Brenier maps
par: Baptista, Ricardo, et autres
Publié: (2024)