LLM-CoOpt: A Co-Design and Optimization Framework for Efficient LLM Inference on Heterogeneous Platforms

Documenti analoghi

• Opt4GPTQ: Co-Optimizing Memory and Computation for 4-bit GPTQ Quantized LLM Inference on Heterogeneous Platforms
  di: Zhang, Yaozheng, et al.
  Pubblicazione: (2025)
• Opt-GPTQ: An Optimized GPTQ Combining Sparse Attention and Quantization Techniques
  di: Kong, Jie, et al.
  Pubblicazione: (2025)
• FleetOpt: Analytical Fleet Provisioning for LLM Inference with Compress-and-Route as Implementation Mechanism
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• A Pipelined Collaborative Speculative Decoding Framework for Efficient Edge-Cloud LLM Inference
  di: Zhang, Yida, et al.
  Pubblicazione: (2026)
• Federated Inference for Heterogeneous LLM Communication and Collaboration
  di: Chen, Zihan, et al.
  Pubblicazione: (2026)