Accelerating Mobile Inference through Fine-Grained CPU-GPU Co-Execution

Documenti analoghi

• A Study on Inference Latency for Vision Transformers on Mobile Devices
  di: Li, Zhuojin, et al.
  Pubblicazione: (2025)
• xMem: A CPU-Based Approach for Accurate Estimation of GPU Memory in Deep Learning Training Workloads
  di: Shi, Jiabo, et al.
  Pubblicazione: (2025)
• HybridGen: Efficient LLM Generative Inference via CPU-GPU Hybrid Computing
  di: Lin, Mao, et al.
  Pubblicazione: (2026)
• Blink: CPU-Free LLM Inference by Delegating the Serving Stack to GPU and SmartNIC
  di: Siavashi, Mohammad, et al.
  Pubblicazione: (2026)
• Characterizing WebGPU Dispatch Overhead for LLM Inference Across Four GPU Vendors, Three Backends, and Three Browsers
  di: Maczan, Jędrzej
  Pubblicazione: (2026)