Athena: Efficient Block-Wise Post-Training Quantization for Large Language Models Using Second-Order Matrix Derivative Information

Documenti analoghi

• Interactions Across Blocks in Post-Training Quantization of Large Language Models
  di: Shabanovi, Khasmamad, et al.
  Pubblicazione: (2024)
• SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
  di: Xiao, Guangxuan, et al.
  Pubblicazione: (2022)
• EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  di: Chen, Mengzhao, et al.
  Pubblicazione: (2024)
• Task-Stratified Knowledge Scaling Laws for Post-Training Quantized Large Language Models
  di: Zhou, Chenxi, et al.
  Pubblicazione: (2025)
• APTQ: Attention-aware Post-Training Mixed-Precision Quantization for Large Language Models
  di: Guan, Ziyi, et al.
  Pubblicazione: (2024)