Cover Image

AMO: Adaptive Muon Orthogonalization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhuang, Xinlin, Ouyang, Panyi, Li, Yichen, Shi, Jiangming, Chen, Yizhang, Liu, Shuman, Qian, Ying, Liu, Weiyang, Zhang, Haibo, Razzak, Imran
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CHIPS: Efficient CLIP Adaptation via Curvature-aware Hybrid Influence-based Data Selection
by: Zhuang, Xinlin, et al.
Published: (2025)

Orthogonal Model Merging
by: Yang, Sihan, et al.
Published: (2026)

AdaGrad Meets Muon: Adaptive Stepsizes for Orthogonal Updates
by: Zhang, Minxin, et al.
Published: (2025)

scAGC: Learning Adaptive Cell Graphs with Contrastive Guidance for Single-Cell Clustering
by: Li, Huifa, et al.
Published: (2025)

MuonEq: Balancing Before Orthogonalization with Lightweight Equilibration
by: Chang, Da, et al.
Published: (2026)

TrasMuon: Trust-Region Adaptive Scaling for Orthogonalized Momentum Optimizers
by: Cheng, Peng, et al.
Published: (2026)

FedMuon: Accelerating Federated Learning with Matrix Orthogonalization
by: Liu, Junkang, et al.
Published: (2025)

Pion: A Spectrum-Preserving Optimizer via Orthogonal Equivalence Transformation
by: Shi, Kexuan, et al.
Published: (2026)

Muon-OGD: Muon-based Spectral Orthogonal Gradient Projection for LLM Continual Learning
by: Lu, Binghang, et al.
Published: (2026)

POET-X: Memory-efficient LLM Training by Scaling Orthogonal Transformation
by: Qiu, Zeju, et al.
Published: (2026)

AdaMuon: Adaptive Muon Optimizer
by: Si, Chongjie, et al.
Published: (2025)

Adam Improves Muon: Adaptive Moment Estimation with Orthogonalized Momentum
by: Zhang, Minxin, et al.
Published: (2026)

DeLo: Dual Decomposed Low-Rank Experts Collaboration for Continual Missing Modality Learning
by: Liu, Xiwei, et al.
Published: (2026)

MuonBP: Faster Muon via Block-Periodic Orthogonalization
by: Khaled, Ahmed, et al.
Published: (2025)

Preconditioning Benefits of Spectral Orthogonalization in Muon
by: Ma, Jianhao, et al.
Published: (2026)

Muon$^2$: Boosting Muon via Adaptive Second-Moment Preconditioning
by: Liu, Ziyue, et al.
Published: (2026)

ESPO: Entropy Importance Sampling Policy Optimization
by: Sheng, Yuepeng, et al.
Published: (2025)

GAMED: Knowledge Adaptive Multi-Experts Decoupling for Multimodal Fake News Detection
by: Shen, Lingzhi, et al.
Published: (2024)

AMO Sampler: Enhancing Text Rendering with Overshooting
by: Hu, Xixi, et al.
Published: (2024)

AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Control
by: Li, Jialong, et al.
Published: (2025)

A Machine Learning Approach to Predict Biological Age and its Longitudinal Drivers
by: Dunbayeva, Nazira, et al.
Published: (2025)

Orthogonal Finetuning Made Scalable
by: Qiu, Zeju, et al.
Published: (2025)

NorMuon: Making Muon more efficient and scalable
by: Li, Zichong, et al.
Published: (2025)

Efficient and Interpretable Transformer for Counterfactual Fairness
by: Dong, Panyi, et al.
Published: (2026)

Automated Machine Learning in Insurance
by: Dong, Panyi, et al.
Published: (2024)

Model Merging with Functional Dual Anchors
by: Shi, Kexuan, et al.
Published: (2025)

DP-Muon: Differentially Private Optimization via Matrix-Orthogonalized Momentum
by: Kim, Jihwan, et al.
Published: (2026)

Efficient Traffic Forecasting on Large-Scale Road Network by Regularized Adaptive Graph Convolution
by: Wu, Kaiqi, et al.
Published: (2025)

InsurTech innovation using natural language processing
by: Dong, Panyi, et al.
Published: (2025)

MuonQ: Enhancing Low-Bit Muon Quantization via Directional Fidelity Optimization
by: Su, Yupeng, et al.
Published: (2026)

Towards Robust Visual Continual Learning with Multi-Prototype Supervision
by: Liu, Xiwei, et al.
Published: (2025)

Reparameterized LLM Training via Orthogonal Equivalence Transformation
by: Qiu, Zeju, et al.
Published: (2025)

Muon Optimizes Under Spectral Norm Constraints
by: Chen, Lizhang, et al.
Published: (2025)

Each Prompt Matters: Scaling Reinforcement Learning Without Wasting Rollouts on Hundred-Billion-Scale MoE
by: Zeng, Anxiang, et al.
Published: (2025)

NarrationDep: Narratives on Social Media For Automatic Depression Detection
by: Zogan, Hamad, et al.
Published: (2024)

On the Convergence of Muon and Beyond
by: Chang, Da, et al.
Published: (2025)

HIPPD: Brain-Inspired Hierarchical Information Processing for Personality Detection
by: Chen, Guanming, et al.
Published: (2025)

Controlling Text-to-Image Diffusion by Orthogonal Finetuning
by: Qiu, Zeju, et al.
Published: (2023)

From Uncertainty to Trust: Kernel Dropout for AI-Powered Medical Predictions
by: Azam, Ubaid, et al.
Published: (2024)

BayesJudge: Bayesian Kernel Language Modelling with Confidence Uncertainty in Legal Judgment Prediction
by: Azam, Ubaid, et al.
Published: (2024)