Clover-2: Accurate Inference for Regressive Lightweight Speculative Decoding

Documenti analoghi

• Clover: Regressive Lightweight Speculative Decoding with Sequential Knowledge
  di: Xiao, Bin, et al.
  Pubblicazione: (2024)
• Boosting Lossless Speculative Decoding via Feature Sampling and Partial Alignment Distillation
  di: Gui, Lujun, et al.
  Pubblicazione: (2024)
• Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration
  di: Wen, Zhuofan, et al.
  Pubblicazione: (2024)
• Semi-Clairvoyant Scheduling of Speculative Decoding Requests to Minimize LLM Inference Latency
  di: Li, Ruixiao, et al.
  Pubblicazione: (2025)
• LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding
  di: Elhoushi, Mostafa, et al.
  Pubblicazione: (2024)