VOCABTRIM: Vocabulary Pruning for Efficient Speculative Decoding in LLMs

Documenti analoghi

• Direct Alignment of Draft Model for Speculative Decoding with Chat-Fine-Tuned LLMs
  di: Goel, Raghavv, et al.
  Pubblicazione: (2024)
• On Speculative Decoding for Multimodal Large Language Models
  di: Gagrani, Mukul, et al.
  Pubblicazione: (2024)
• Recursive Speculative Decoding: Accelerating LLM Inference via Sampling Without Replacement
  di: Jeon, Wonseok, et al.
  Pubblicazione: (2024)
• Efficient Training-Free Multi-Token Prediction via Embedding-Space Probing
  di: Goel, Raghavv, et al.
  Pubblicazione: (2026)
• Spiffy: Multiplying Diffusion LLM Acceleration via Lossless Speculative Decoding
  di: Agrawal, Sudhanshu, et al.
  Pubblicazione: (2025)