OstQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitting

Documenti analoghi

• MambaQuant: Quantizing the Mamba Family with Variance Aligned Rotation Methods
  di: Xu, Zukang, et al.
  Pubblicazione: (2025)
• MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance
  di: Hu, Xing, et al.
  Pubblicazione: (2025)
• I-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models
  di: Hu, Xing, et al.
  Pubblicazione: (2024)
• RWKVQuant: Quantizing the RWKV Family with Proxy Guided Hybrid of Scalar and Vector Quantization
  di: Xu, Chen, et al.
  Pubblicazione: (2025)
• TORQ: Two-Level Orthogonal Rotation for MXFP4 Quantization
  di: Xu, Zukang, et al.
  Pubblicazione: (2026)