LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models

Documenti analoghi

• PrefillShare: A Shared Prefill Module for KV Reuse in Multi-LLM Disaggregated Serving
  di: Woo, Sunghyeon, et al.
  Pubblicazione: (2026)
• CodeGEMM: A Codebook-Centric Approach to Efficient GEMM in Quantized LLMs
  di: Park, Gunho, et al.
  Pubblicazione: (2025)
• AnyBCQ: Hardware Efficient Flexible Binary-Coded Quantization for Multi-Precision LLMs
  di: Park, Gunho, et al.
  Pubblicazione: (2025)
• FIGLUT: An Energy-Efficient Accelerator Design for FP-INT GEMM Using Look-Up Tables
  di: Park, Gunho, et al.
  Pubblicazione: (2025)
• An Inquiry into Datacenter TCO for LLM Inference with FP8
  di: Kim, Jiwoo, et al.
  Pubblicazione: (2025)