ABQ-LLM: Arbitrary-Bit Quantized Inference Acceleration for Large Language Models

Documenti analoghi

• GQSA: Group Quantization and Sparsity for Accelerating Large Language Model Inference
  di: Zeng, Chao, et al.
  Pubblicazione: (2024)
• Error Propagation Mechanisms and Compensation Strategies for Quantized Diffusion
  di: Liu, Songwei, et al.
  Pubblicazione: (2025)
• FoldGPT: Simple and Effective Large Language Model Compression Scheme
  di: Liu, Songwei, et al.
  Pubblicazione: (2024)
• Hybrid SD: Edge-Cloud Collaborative Inference for Stable Diffusion Models
  di: Yan, Chenqian, et al.
  Pubblicazione: (2024)
• I-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models
  di: Hu, Xing, et al.
  Pubblicazione: (2024)