AdaSpec: Adaptive Speculative Decoding for Fast, SLO-Aware Large Language Model Serving

Documenti analoghi

• AdaServe: Accelerating Multi-SLO LLM Serving with SLO-Customized Speculative Decoding
  di: Li, Zikun, et al.
  Pubblicazione: (2025)
• UniScale: Adaptive Unified Inference Scaling via Online Joint Optimization of Model Routing and Test-Time Scaling
  di: Huang, Kaiyu, et al.
  Pubblicazione: (2026)
• AdaSD: Adaptive Speculative Decoding for Efficient Language Model Inference
  di: Lu, Kuan-Wei, et al.
  Pubblicazione: (2025)
• ViSpec: Accelerating Vision-Language Models with Vision-Aware Speculative Decoding
  di: Kang, Jialiang, et al.
  Pubblicazione: (2025)
• SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification
  di: Miao, Xupeng, et al.
  Pubblicazione: (2023)