Opt4GPTQ: Co-Optimizing Memory and Computation for 4-bit GPTQ Quantized LLM Inference on Heterogeneous Platforms

Documenti analoghi

• Opt-GPTQ: An Optimized GPTQ Combining Sparse Attention and Quantization Techniques
  di: Kong, Jie, et al.
  Pubblicazione: (2025)
• LLM-CoOpt: A Co-Design and Optimization Framework for Efficient LLM Inference on Heterogeneous Platforms
  di: Kong, Jie, et al.
  Pubblicazione: (2026)
• Performance Impact of Containerized METADOCK 2 on Heterogeneous Platforms
  di: Banegas-Luna, Antonio Jesús, et al.
  Pubblicazione: (2025)
• Characterizing Adaptive Mesh Refinement on Heterogeneous Platforms with Parthenon-VIBE
  di: Poptani, Akash, et al.
  Pubblicazione: (2025)
• HybridGen: Efficient LLM Generative Inference via CPU-GPU Hybrid Computing
  di: Lin, Mao, et al.
  Pubblicazione: (2026)