LFQ: Logit-aware Final-block Quantization for Boosting the Generation Quality of Low-Bit Quantized LLMs

Documenti analoghi

• LRQ: Optimizing Post-Training Quantization for Large Language Models by Learning Low-Rank Weight-Scaling Matrices
  di: Lee, Jung Hyun, et al.
  Pubblicazione: (2024)
• No Token Left Behind: Reliable KV Cache Compression via Importance-Aware Mixed Precision Quantization
  di: Yang, June Yong, et al.
  Pubblicazione: (2024)
• Enhancing Generalization in Data-free Quantization via Mixup-class Prompting
  di: Park, Jiwoong, et al.
  Pubblicazione: (2025)
• Quantization Meets Reasoning: Exploring LLM Low-Bit Quantization Degradation for Mathematical Reasoning
  di: Li, Zhen, et al.
  Pubblicazione: (2025)
• Q-Palette: Fractional-Bit Quantizers Toward Optimal Bit Allocation for Efficient LLM Deployment
  di: Lee, Deokjae, et al.
  Pubblicazione: (2025)