A Hardware-Aware, Per-Layer Methodology for Post-Training Quantization of Large Language Models

Documenti analoghi

• SigmaQuant: Hardware-Aware Heterogeneous Quantization Method for Edge DNN Inference
  di: Liu, Qunyou, et al.
  Pubblicazione: (2026)
• Exploring Quantization and Mapping Synergy in Hardware-Aware Deep Neural Network Accelerators
  di: Klhufek, Jan, et al.
  Pubblicazione: (2024)
• Rescaling-Aware Training for Efficient Deployment of Deep Learning Models on Full-Integer Hardware
  di: Mueller, Lion, et al.
  Pubblicazione: (2025)
• Large Language Model Inference Acceleration: A Comprehensive Hardware Perspective
  di: Li, Jinhao, et al.
  Pubblicazione: (2024)
• Improving Quantization with Post-Training Model Expansion
  di: Franco, Giuseppe, et al.
  Pubblicazione: (2025)