CBQ: Cross-Block Quantization for Large Language Models

Documenti analoghi

• Multi-Granularity Semantic Revision for Large Language Model Distillation
  di: Liu, Xiaoyu, et al.
  Pubblicazione: (2024)
• Rethinking 1-bit Optimization Leveraging Pre-trained Large Language Models
  di: Tu, Zhijun, et al.
  Pubblicazione: (2025)
• Saliency-driven Dynamic Token Pruning for Large Language Models
  di: Tao, Yao, et al.
  Pubblicazione: (2025)
• EMS-SD: Efficient Multi-sample Speculative Decoding for Accelerating Large Language Models
  di: Ni, Yunsheng, et al.
  Pubblicazione: (2024)
• EAQuant: Enhancing Post-Training Quantization for MoE Models via Expert-Aware Optimization
  di: Fu, Zhongqian, et al.
  Pubblicazione: (2025)