Image de couverture de livre

When, What, and How: Rethinking Retrieval-Enhanced Speculative Decoding

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Fang, Min, Fu, Zhihui, Zhao, Qibin, Wang, Jun
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding
par: Li, Guanghao, et autres
Publié: (2025)

RACER: Retrieval-Augmented Contextual Rapid Speculative Decoding
par: Zhang, Zihong, et autres
Publié: (2026)

RASD: Retrieval-Augmented Speculative Decoding
par: Quan, Guofeng, et autres
Publié: (2025)

Bridging Draft Policy Misalignment: Group Tree Optimization for Speculative Decoding
par: Hu, Shijing, et autres
Publié: (2025)

GRIFFIN: Effective Token Alignment for Faster Speculative Decoding
par: Hu, Shijing, et autres
Publié: (2025)

CREST: Effectively Compacting a Datastore For Retrieval-Based Speculative Decoding
par: Ho, Sophia, et autres
Publié: (2024)

Mixture of Attentions For Speculative Decoding
par: Zimmer, Matthieu, et autres
Publié: (2024)

Cross-Attention Speculative Decoding
par: Zhong, Wei, et autres
Publié: (2025)

Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QA
par: Roy, Nirmal, et autres
Publié: (2024)

Draft Model Knows When to Stop: Self-Verification Speculative Decoding for Long-Form Generation
par: Zhang, Ziyin, et autres
Publié: (2024)

Scaling Laws for Speculative Decoding
par: Yan, Siyuan, et autres
Publié: (2025)

Dynamic Depth Decoding: Faster Speculative Decoding for LLMs
par: Brown, Oscar, et autres
Publié: (2024)

REST: Retrieval-Based Speculative Decoding
par: He, Zhenyu, et autres
Publié: (2023)

Speculative RAG: Enhancing Retrieval Augmented Generation through Drafting
par: Wang, Zilong, et autres
Publié: (2024)

The Disparate Impacts of Speculative Decoding
par: Sandler, Jameson, et autres
Publié: (2025)

Speculative Decoding: Performance or Illusion?
par: Liu, Xiaoxuan, et autres
Publié: (2025)

Mamba Drafters for Speculative Decoding
par: Choi, Daewon, et autres
Publié: (2025)

Constrained Decoding with Speculative Lookaheads
par: Nakshatri, Nishanth, et autres
Publié: (2024)

Goose: Anisotropic Speculation Trees for Training-Free Speculative Decoding
par: Jin, Tao, et autres
Publié: (2026)

Speculative Decoding for Multi-Sample Inference
par: Li, Yiwei, et autres
Publié: (2025)

Batch Speculative Decoding Done Right
par: Zhang, Ranran Haoran, et autres
Publié: (2025)

Cacheback: Speculative Decoding With Nothing But Cache
par: Ma, Zhiyao, et autres
Publié: (2025)

SENSE: Semantic Embedding Navigation with Soft-gated Evaluation for Retrieval-based Speculative Decoding
par: Chen, Shaowen, et autres
Publié: (2026)

Hybrid Verified Decoding: Learning to Allocate Verification in Speculative Decoding
par: Su, Xin, et autres
Publié: (2026)

TokenTiming: A Dynamic Alignment Method for Universal Speculative Decoding Model Pairs
par: Xiao, Sibo, et autres
Publié: (2025)

Online Speculative Decoding
par: Liu, Xiaoxuan, et autres
Publié: (2023)

Speculate, then Collaborate: Fusing Knowledge of Language Models during Decoding
par: Wang, Ziyao, et autres
Publié: (2025)

When Speculation Spills Secrets: Side Channels via Speculative Decoding In LLMs
par: Wei, Jiankun, et autres
Publié: (2024)

PACER: Blockwise Pre-verification for Speculative Decoding with Adaptive Length
par: Zhang, Situo, et autres
Publié: (2026)

Reward-Guided Speculative Decoding for Efficient LLM Reasoning
par: Liao, Baohao, et autres
Publié: (2025)

Acceptance Dynamics Across Cognitive Domains in Speculative Decoding
par: Mahmoud, Saif
Publié: (2026)

Speculative Decoding Meets Quantization: Compatibility Evaluation and Hierarchical Framework Design
par: Zhang, Yudi, et autres
Publié: (2025)

Fast Large Language Model Collaborative Decoding via Speculation
par: Fu, Jiale, et autres
Publié: (2025)

A Theoretical Perspective for Speculative Decoding Algorithm
par: Yin, Ming, et autres
Publié: (2024)

Token-Driven GammaTune: Adaptive Calibration for Enhanced Speculative Decoding
par: Gautam, Aayush, et autres
Publié: (2025)

SAM Decoding: Speculative Decoding via Suffix Automaton
par: Hu, Yuxuan, et autres
Publié: (2024)

TETRIS: Optimal Draft Token Selection for Batch Speculative Decoding
par: Wu, Zhaoxuan, et autres
Publié: (2025)

Entropy-Aware Speculative Decoding Toward Improved LLM Reasoning
par: Su, Tiancheng, et autres
Publié: (2025)

SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding
par: Sun, Ryan, et autres
Publié: (2024)

SpecVLM: Enhancing Speculative Decoding of Video LLMs via Verifier-Guided Token Pruning
par: Ji, Yicheng, et autres
Publié: (2025)