Cover Image

Effective Quantization of Muon Optimizer States

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gupta, Aman, Celente, Rafael, Shivanna, Abhishek, Braithwaite, D. T., Dexter, Gregory, Tang, Shao, Udagawa, Hiroto, Silva, Daniel, Ramanath, Rohan, Keerthi, S. Sathiya
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Precise Characterization of SGD Stability Using Loss Surface Geometry
by: Dexter, Gregory, et al.
Published: (2024)

Your Spending Needs Attention: Modeling Financial Habits with Transformers
by: Braithwaite, D. T., et al.
Published: (2025)

FFSplit: Split Feed-Forward Network For Optimizing Accuracy-Efficiency Trade-off in Language Model Inference
by: Liu, Zirui, et al.
Published: (2024)

LLM Query Scheduling with Prefix Reuse and Latency Constraints
by: Dexter, Gregory, et al.
Published: (2025)

Crenças, expectativas e padrão de consumo do álcool por mulheres
by: Andressa Celente de Ávila
Published: (2013)

AlphaPO: Reward Shape Matters for LLM Alignment
by: Gupta, Aman, et al.
Published: (2025)

MuonQ: Enhancing Low-Bit Muon Quantization via Directional Fidelity Optimization
by: Su, Yupeng, et al.
Published: (2026)

optimizn: a Python Library for Developing Customized Optimization Algorithms
by: Sathiya, Akshay, et al.
Published: (2025)

Efficient Photocatalytic Degradation of Methylene Blue From Aqueous Solution Using Hybrid Biomass‐Derived Nanostructured Carbon‐TiO2 Photocatalyst
by: Aman Sharma, et al.
Published: (2025)

Non-Hamiltonian 2-regular Digraphs
by: Ramanath, Munagala V. S.
Published: (2025)

Non-Hamiltonian 2-regular Digraphs -- Residues
by: Ramanath, Munagala V.
Published: (2026)

The tt*-structure for the quantum cohomology of complex Grassmannian
by: Udagawa, Tadashi
Published: (2025)

Globality of the DPW construction for Smyth potentials in the case of SU(1,1)
by: Udagawa, Tadashi
Published: (2023)

On tt*-structures from $ADE$-type Stokes data
by: Udagawa, Tadashi
Published: (2026)

Classification of Toda-type tt*-structures and $\mathbb{Z}_{n+1}$-fixed points
by: Udagawa, Tadashi
Published: (2025)

Advancing Model Refinement: Muon-Optimized Distillation and Quantization for LLM Deployment
by: Sander, Jacob, et al.
Published: (2026)

Distance-Aware Muon: Adaptive Step Scaling for Normalized Optimization
by: Demidovich, Yury, et al.
Published: (2026)

An efficient data compression and storage technique with key management authentication in cloud space
by: Surekha Pinnapati, Prakasha Shivanna
Published: (2024)

Mapping the AMS-02 and CALET Data onto the Source Spectra and Residence Times of Galactic Cosmic Rays
by: Cowsik, Ramanath, et al.
Published: (2023)

The Correspondence Between Leaky-Box and Diffusion Models of Cosmic-Ray Propagation
by: Cowsik, Ramanath, et al.
Published: (2025)

Nucleotide degradation and production of hypoxanthine in some Indian marine and freshwater fishes
by: Ramanath, S., et al.
Published: (1977)

Macrocriminology and Freedom
by: Braithwaite, John
Published: (2022)

Simple Solutions to Complex Catastrophes
by: Braithwaite, John
Published: (2024)

Hot, Retrograde Tilted MADs: Misaligned, Precessing, and Shaped by Electromagnetic Torques
by: Gupta, Sajal, et al.
Published: (2026)

Shock-induced partial alignment in geometrically-thick tilted accretion disks around black holes
by: Gupta, Sajal, et al.
Published: (2024)

AdaMuon: Adaptive Muon Optimizer
by: Si, Chongjie, et al.
Published: (2025)

LiMAML: Personalization of Deep Recommender Models via Meta Learning
by: Wang, Ruofan, et al.
Published: (2024)

Anomie and Violence
by: Braithwaite, John, et al.
Published: (2013)

Physics-Informed Functional Link Constrained Framework with Domain Mapping for Solving Bending Analysis of an Exponentially Loaded Perforated Beam
by: Sahu, Iswari, et al.
Published: (2026)

Comparative Study of Bending Analysis using Physics-Informed Neural Networks and Numerical Dynamic Deflection in Perforated nanobeam
by: Garai, Ramanath, et al.
Published: (2026)

PLOTTING NEW MIDDLE ‐ CLASS ASPIRATIONS : ‘Outlaw’ Builders of Market‐rate Affordable Homes in Chennai's Agrarian Urban Frontier
by: Ramya Ramanath, et al.
Published: (2025)

The EnvDesign Model: A Method to Solve the Environment Design Problem
by: Sathiya, Akshay, et al.
Published: (2024)

Understanding Quantization of Optimizer States in LLM Pre-training: Dynamics of State Staleness and Effectiveness of State Resets
by: Topollai, Kristi, et al.
Published: (2026)

SignMuon: Communication-Efficient Distributed Muon Optimization
by: Mishra, Neel, et al.
Published: (2026)

The Effective Theory of Muon-to-Electron Conversion
by: Haxton, W. C., et al.
Published: (2026)

The Newton-Muon Optimizer
by: Du, Zhehang, et al.
Published: (2026)

Cascades of Violence
by: Braithwaite, John, et al.
Published: (2018)

Spinon band flattening by its emergent gauge field in quantum kagome ice
by: Udagawa, Masafumi, et al.
Published: (2025)

Step-by-step derivation of the nuclear fusion radius
by: Gomez-Camacho A., and Udagawa T
Published: (1998)

Blind-Adaptive Quantizers
by: Chemmala, Aman Rishal, et al.
Published: (2024)