QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models

Documenti analoghi

• ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models
  di: Liu, Jing, et al.
  Pubblicazione: (2024)
• FlashBlock: Attention Caching for Efficient Long-Context Block Diffusion
  di: Chen, Zhuokun, et al.
  Pubblicazione: (2026)
• LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit
  di: Gong, Ruihao, et al.
  Pubblicazione: (2024)
• SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
  di: Xiao, Guangxuan, et al.
  Pubblicazione: (2022)
• MiniCache: KV Cache Compression in Depth Dimension for Large Language Models
  di: Liu, Akide, et al.
  Pubblicazione: (2024)