Cover Image

Spectral Flattening Is All Muon Needs: How Orthogonalization Controls Learning Rate and Convergence

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nguyen, Tien-Phat, Nguyen, Truong, Truong, Minh-Phuc, Nguyen, Tuc, Bailey, James, Le, Trung
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

BSO: Safety Alignment Is Density Ratio Matching
by: Nguyen, Tien-Phat, et al.
Published: (2026)

Amortized Optimal Transport from Sliced Potentials
by: Truong, Minh-Phuc, et al.
Published: (2026)

TokenRatio: Principled Token-Level Preference Optimization via Ratio Matching
by: Nguyen, Truong, et al.
Published: (2026)

XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approach
by: Nguyen, Truong Thanh Hung, et al.
Published: (2024)

RAISE: A Unified Framework for Responsible AI Scoring and Evaluation
by: Nguyen, Loc Phuc Truong, et al.
Published: (2025)

SegMaFormer: A Hybrid State-Space and Transformer Model for Efficient Segmentation
by: Nguyen, Duy D., et al.
Published: (2026)

Causal Graph Learning via Distributional Invariance of Cause-Effect Relationship
by: Nguyen, Nang Hung, et al.
Published: (2026)

Spectral Text Fusion: A Frequency-Aware Approach to Multimodal Time-Series Forecasting
by: Nguyen, Huu Hiep, et al.
Published: (2026)

Deepfake Audio Detection Using Spectrogram-based Feature and Ensemble of Deep Learning Models
by: Pham, Lam, et al.
Published: (2024)

Selective Off-Policy Reference Tuning with Plan Guidance
by: Le, Duc Anh, et al.
Published: (2026)

Fake Advertisements Detection Using Automated Multimodal Learning: A Case Study for Vietnamese Real Estate Data
by: Nguyen, Duy, et al.
Published: (2025)

MACeIP: A Multimodal Ambient Context-enriched Intelligence Platform in Smart Cities
by: Nguyen, Truong Thanh Hung, et al.
Published: (2024)

Motion2Meaning: A Clinician-Centered Framework for Contestable LLM in Parkinson's Disease Gait Interpretation
by: Nguyen, Loc Phuc Truong, et al.
Published: (2025)

Spectral Entropy Collapse as a Phase Transition in Delayed Generalisation: An Interventional and Predictive Framework for Grokkin
by: Khanh, Truong Xuan, et al.
Published: (2026)

Adaptive Collaboration of Arena-Based Argumentative LLMs for Explainable and Contestable Legal Reasoning
by: Cao, Hoang-Loc, et al.
Published: (2026)

New Benchmark Dataset and Fine-Grained Cross-Modal Fusion Framework for Vietnamese Multimodal Aspect-Category Sentiment Analysis
by: Nguyen, Quy Hoang, et al.
Published: (2024)

Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning
by: Nguyen, Le-Trung, et al.
Published: (2025)

Sharpness-Aware Teleportation on Riemannian Manifolds
by: Truong, Tuan, et al.
Published: (2023)

SKGE: Spherical Knowledge Graph Embedding with Geometric Regularization
by: Quan, Xuan-Truong, et al.
Published: (2025)

Preconditioning Benefits of Spectral Orthogonalization in Muon
by: Ma, Jianhao, et al.
Published: (2026)

Learning Reconfigurable Representations for Multimodal Federated Learning with Missing Data
by: Nguyen, Duong M., et al.
Published: (2025)

Generative Conditional Distributions by Neural (Entropic) Optimal Transport
by: Nguyen, Bao, et al.
Published: (2024)

Agentic AI Meets Edge Computing in Autonomous UAV Swarms
by: Nguyen, Thuan Minh, et al.
Published: (2026)

Rethinking Cross-Modal Fine-Tuning: Optimizing the Interaction Between Feature Alignment and Target Fitting
by: Tran, Trong Khiem, et al.
Published: (2026)

Multi-level Phenotypic Models of Cardiovascular Disease and Obstructive Sleep Apnea Comorbidities: A Longitudinal Wisconsin Sleep Cohort Study
by: Nguyen, Duy, et al.
Published: (2024)

Empowering Contrastive Federated Sequential Recommendation with LLMs
by: Nguyen, Thi Minh Chau, et al.
Published: (2026)

A Differential and Pointwise Control Approach to Reinforcement Learning
by: Nguyen, Minh, et al.
Published: (2024)

Variable-Agnostic Causal Exploration for Reinforcement Learning
by: Nguyen, Minh Hoang, et al.
Published: (2024)

Decoupled Continuous-Time Reinforcement Learning via Hamiltonian Flow
by: Nguyen, Minh
Published: (2026)

Variational Quantum Rainbow Deep Q-Network for Optimizing Resource Allocation Problem
by: Nguyen, Truong Thanh Hung, et al.
Published: (2025)

Improving Chain-of-Thought for Logical Reasoning via Attention-Aware Intervention
by: Phuong, Nguyen Minh, et al.
Published: (2026)

Efficient Modular Learning through Naive LoRA Summation: Leveraging Orthogonality in High-Dimensional Models
by: Cao, Zhanhao, et al.
Published: (2025)

How Transformers Learn In-Context Recall Tasks? Optimality, Training Dynamics and Generalization
by: Nguyen, Quan, et al.
Published: (2025)

LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Tasks
by: Nguyen, Truong Thanh Hung, et al.
Published: (2024)

Motion Code: Robust Time Series Classification and Forecasting via Sparse Variational Multi-Stochastic Processes Learning
by: Bajaj, Chandrajit, et al.
Published: (2024)

Real-time Speech Summarization for Medical Conversations
by: Le-Duc, Khai, et al.
Published: (2024)

RepLoRA: Reparameterizing Low-Rank Adaptation via the Perspective of Mixture of Experts
by: Truong, Tuan, et al.
Published: (2025)

Toward an Artificial General Teacher: Procedural Geometry Data Generation and Visual Grounding with Vision-Language Models
by: Nguyen-Truong, Hai, et al.
Published: (2026)

Towards Layer-Wise Personalized Federated Learning: Adaptive Layer Disentanglement via Conflicting Gradients
by: Nguyen, Minh Duong, et al.
Published: (2024)

ATLAS: Adaptive Test-Time Latent Steering with External Verifiers for Enhancing LLMs Reasoning
by: Nguyen, Tuc, et al.
Published: (2026)