Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference?

Documenti analoghi

• LQER: Low-Rank Quantization Error Reconstruction for LLMs
  di: Zhang, Cheng, et al.
  Pubblicazione: (2024)
• Hardware and Software Platform Inference
  di: Zhang, Cheng, et al.
  Pubblicazione: (2024)
• AMPLE: Event-Driven Accelerator for Mixed-Precision Inference of Graph Neural Networks
  di: Gimenes, Pedro, et al.
  Pubblicazione: (2025)
• Quantamination: Dynamic Quantization Leaks Your Data Across the Batch
  di: Foerster, Hanna, et al.
  Pubblicazione: (2026)
• NeuraLUT-Assemble: Hardware-aware Assembling of Sub-Neural Networks for Efficient LUT Inference
  di: Andronic, Marta, et al.
  Pubblicazione: (2025)