Opt-GPTQ: An Optimized GPTQ Combining Sparse Attention and Quantization Techniques

Documenti analoghi

• Opt4GPTQ: Co-Optimizing Memory and Computation for 4-bit GPTQ Quantized LLM Inference on Heterogeneous Platforms
  di: Zhang, Yaozheng, et al.
  Pubblicazione: (2025)
• LLM-CoOpt: A Co-Design and Optimization Framework for Efficient LLM Inference on Heterogeneous Platforms
  di: Kong, Jie, et al.
  Pubblicazione: (2026)
• KV Cache Compression for Inference Efficiency in LLMs: A Review
  di: Liu, Yanyu, et al.
  Pubblicazione: (2025)
• AsyncSparse: Accelerating Sparse Matrix-Matrix Multiplication on Asynchronous GPU Architectures
  di: Liu, Jie, et al.
  Pubblicazione: (2026)
• AB-Sparse: Sparse Attention with Adaptive Block Size for Accurate and Efficient Long-Context Inference
  di: Liu, Di, et al.
  Pubblicazione: (2026)