Channel-Wise Mixed-Precision Quantization for Large Language Models

Documenti analoghi

• APTQ: Attention-aware Post-Training Mixed-Precision Quantization for Large Language Models
  di: Guan, Ziyi, et al.
  Pubblicazione: (2024)
• KVTuner: Sensitivity-Aware Layer-Wise Mixed-Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference
  di: Li, Xing, et al.
  Pubblicazione: (2025)
• Efficient Prompt Optimization Through the Lens of Best Arm Identification
  di: Shi, Chengshuai, et al.
  Pubblicazione: (2024)
• Knowledge Editing for Large Language Models: A Survey
  di: Wang, Song, et al.
  Pubblicazione: (2023)
• Separate the Wheat from the Chaff: Winnowing Down Divergent Views in Retrieval Augmented Generation
  di: Wang, Song, et al.
  Pubblicazione: (2025)