Dovetail: A CPU/GPU Heterogeneous Speculative Decoding for LLM inference

Documenti analoghi

• Rhea: Role-aware Heuristic Episodic Attention for Conversational LLMs
  di: Hong, Wanyang, et al.
  Pubblicazione: (2025)
• Sparrow: Text-Anchored Window Attention with Visual-Semantic Glimpsing for Speculative Decoding in Video LLMs
  di: Zhang, Libo, et al.
  Pubblicazione: (2026)
• Nightjar: Dynamic Adaptive Speculative Decoding for Large Language Models Serving
  di: Li, Rui, et al.
  Pubblicazione: (2025)
• Speculative Decoding with a Speculative Vocabulary
  di: Williams, Miles, et al.
  Pubblicazione: (2026)
• SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  di: Xia, Heming, et al.
  Pubblicazione: (2024)