Plato: Plan to Efficiently Decode for Large Language Model Inference

Documenti analoghi

• HeterMoE: Efficient Training of Mixture-of-Experts Models on Heterogeneous GPUs
  di: Wu, Yongji, et al.
  Pubblicazione: (2025)
• Compute Or Load KV Cache? Why Not Both?
  di: Jin, Shuowei, et al.
  Pubblicazione: (2024)
• Learn To be Efficient: Build Structured Sparsity in Large Language Models
  di: Zheng, Haizhong, et al.
  Pubblicazione: (2024)
• Foundry: Template-Based CUDA Graph Context Materialization for Fast LLM Serving Cold Start
  di: Liu, Xueshen, et al.
  Pubblicazione: (2026)
• Eagle: Efficient Training-Free Router for Multi-LLM Inference
  di: Zhao, Zesen, et al.
  Pubblicazione: (2024)