BlockDialect: Block-wise Fine-grained Mixed Format Quantization for Energy-Efficient LLM Inference

Documenti analoghi

• SemanticDialect: Semantic-Aware Mixed-Format Quantization for Video Diffusion Transformers
  di: Jang, Wonsuk, et al.
  Pubblicazione: (2026)
• RaZeR: Pushing the Limits of NVFP4 Quantization with Redundant Zero Remapping
  di: Chen, Yuzong, et al.
  Pubblicazione: (2025)
• Improving Block-Wise LLM Quantization by 4-bit Block-Wise Optimal Float (BOF4): Analysis and Variations
  di: Blumenberg, Patrick, et al.
  Pubblicazione: (2025)
• CBQ: Cross-Block Quantization for Large Language Models
  di: Ding, Xin, et al.
  Pubblicazione: (2023)
• Block Rotation is All You Need for MXFP4 Quantization
  di: Shao, Yuantian, et al.
  Pubblicazione: (2025)