CodeGEMM: A Codebook-Centric Approach to Efficient GEMM in Quantized LLMs

Documenti analoghi

• LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models
  di: Park, Gunho, et al.
  Pubblicazione: (2022)
• FIGLUT: An Energy-Efficient Accelerator Design for FP-INT GEMM Using Look-Up Tables
  di: Park, Gunho, et al.
  Pubblicazione: (2025)
• AnyBCQ: Hardware Efficient Flexible Binary-Coded Quantization for Multi-Precision LLMs
  di: Park, Gunho, et al.
  Pubblicazione: (2025)
• No Token Left Behind: Reliable KV Cache Compression via Importance-Aware Mixed Precision Quantization
  di: Yang, June Yong, et al.
  Pubblicazione: (2024)
• Affine-Scaled Attention: Towards Flexible and Stable Transformer Attention
  di: Bae, Jeongin, et al.
  Pubblicazione: (2026)