KNN-SSD: Enabling Dynamic Self-Speculative Decoding via Nearest Neighbor Layer Set Optimization

Documenti analoghi

• ToolSpec: Accelerating Tool Calling via Schema-Aware and Retrieval-Augmented Speculative Decoding
  di: Xia, Heming, et al.
  Pubblicazione: (2026)
• Merlin's Whisper: Enabling Efficient Reasoning in Large Language Models via Black-box Persuasive Prompting
  di: Xia, Heming, et al.
  Pubblicazione: (2025)
• TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  di: Xia, Heming, et al.
  Pubblicazione: (2025)
• SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  di: Xia, Heming, et al.
  Pubblicazione: (2024)
• Finding RELIEF: Shaping Reasoning Behavior without Reasoning Supervision via Belief Engineering
  di: Leong, Chak Tou, et al.
  Pubblicazione: (2026)