LeanQuant: Accurate and Scalable Large Language Model Quantization with Loss-error-aware Grid

Ähnliche Einträge

• KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization
  von: Zhang, Tianyi, et al.
  Veröffentlicht: (2024)
• Learning Scalable Structural Representations for Link Prediction with Bloom Signatures
  von: Zhang, Tianyi, et al.
  Veröffentlicht: (2023)
• GuidedQuant: Large Language Model Quantization via Exploiting End Loss Guidance
  von: Kim, Jinuk, et al.
  Veröffentlicht: (2025)
• SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
  von: Xiao, Guangxuan, et al.
  Veröffentlicht: (2022)
• MergeQuant: Accurate 4-bit Static Quantization of Large Language Models by Channel-wise Calibration
  von: Wang, Jinguang, et al.
  Veröffentlicht: (2025)