MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantization

Documenti analoghi

• OstQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitting
  di: Hu, Xing, et al.
  Pubblicazione: (2025)
• MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance
  di: Hu, Xing, et al.
  Pubblicazione: (2025)
• I-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models
  di: Hu, Xing, et al.
  Pubblicazione: (2024)
• RWKVQuant: Quantizing the RWKV Family with Proxy Guided Hybrid of Scalar and Vector Quantization
  di: Xu, Chen, et al.
  Pubblicazione: (2025)
• RSAVQ: Riemannian Sensitivity-Aware Vector Quantization for Large Language Models
  di: Xu, Zukang, et al.
  Pubblicazione: (2025)