EasyQuant: An Efficient Data-free Quantization Algorithm for LLMs

Documenti analoghi

• Tequila: Trapping-free Ternary Quantization for Large Language Models
  di: Huang, Hong, et al.
  Pubblicazione: (2025)
• Sherry: Hardware-Efficient 1.25-Bit Ternary Quantization via Fine-grained Sparsification
  di: Huang, Hong, et al.
  Pubblicazione: (2026)
• E-Sparse: Boosting the Large Language Model Inference through Entropy-based N:M Sparsity
  di: Li, Yun, et al.
  Pubblicazione: (2023)
• D$^2$Quant: Accurate Low-bit Post-Training Weight Quantization for LLMs
  di: Yan, Xianglong, et al.
  Pubblicazione: (2026)
• Quant.npu: Enabling Efficient Mobile NPU Inference for on-device LLMs via Fully Static Quantization
  di: Zhang, Jinghe, et al.
  Pubblicazione: (2026)