MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance

Documenti analoghi

• MoBiE: Efficient Inference of Mixture of Binary Experts under Post-Training Quantization
  di: Zhao, Zhixiong, et al.
  Pubblicazione: (2026)
• RWKVQuant: Quantizing the RWKV Family with Proxy Guided Hybrid of Scalar and Vector Quantization
  di: Xu, Chen, et al.
  Pubblicazione: (2025)
• OstQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitting
  di: Hu, Xing, et al.
  Pubblicazione: (2025)
• MambaQuant: Quantizing the Mamba Family with Variance Aligned Rotation Methods
  di: Xu, Zukang, et al.
  Pubblicazione: (2025)
• KBVQ-MoE: KLT-guided SVD with Bias-Corrected Vector Quantization for MoE Large Language Models
  di: Xu, Zukang, et al.
  Pubblicazione: (2026)