Efficient Edge LLMs Deployment via HessianAware Quantization and CPU GPU Collaborative

Documenti analoghi

• CoMoE: Collaborative Optimization of Expert Aggregation and Offloading for MoE-based LLMs at Edge
  di: Li, Muqing, et al.
  Pubblicazione: (2025)
• The MoE-Empowered Edge LLMs Deployment: Architecture, Challenges, and Opportunities
  di: Li, Ning, et al.
  Pubblicazione: (2025)
• Edge Deployment of Small Language Models, a comprehensive comparison of CPU, GPU and NPU backends
  di: Prieto, Pablo, et al.
  Pubblicazione: (2025)
• A QoE-Aware Split Inference Accelerating Algorithm for NOMA-based Edge Intelligence
  di: Yuan, Xin, et al.
  Pubblicazione: (2024)
• One QuantLLM for ALL: Fine-tuning Quantized LLMs Once for Efficient Deployments
  di: Yi, Ke, et al.
  Pubblicazione: (2024)