SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Documenti analoghi

• Efficient Streaming Language Models with Attention Sinks
  di: Xiao, Guangxuan, et al.
  Pubblicazione: (2023)
• ParoQuant: Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
  di: Liang, Yesheng, et al.
  Pubblicazione: (2025)
• OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models
  di: Shao, Wenqi, et al.
  Pubblicazione: (2023)
• SliderQuant: Accurate Post-Training Quantization for LLMs
  di: Wang, Shigeng, et al.
  Pubblicazione: (2026)
• Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling
  di: Cook, Jack, et al.
  Pubblicazione: (2025)