Improving Block-Wise LLM Quantization by 4-bit Block-Wise Optimal Float (BOF4): Analysis and Variations

Documenti analoghi

• EBFT: Effective and Block-Wise Fine-Tuning for Sparse LLMs
  di: Guo, Song, et al.
  Pubblicazione: (2024)
• LoSA: Locality Aware Sparse Attention for Block-Wise Diffusion Language Models
  di: Xi, Haocheng, et al.
  Pubblicazione: (2026)
• Athena: Efficient Block-Wise Post-Training Quantization for Large Language Models Using Second-Order Matrix Derivative Information
  di: Wang, Yanshu, et al.
  Pubblicazione: (2024)
• Block-Wise Differentiable Sinkhorn Attention: Tail-Refinement Gradients with a Gap-Aware Dustbin Bridge
  di: Forde, Dylan
  Pubblicazione: (2026)
• Block Rotation is All You Need for MXFP4 Quantization
  di: Shao, Yuantian, et al.
  Pubblicazione: (2025)