Imagen de Portada

Improving Multi-candidate Speculative Decoding

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lu, Xiaofan, Zeng, Yixiao, Ma, Feiyang, Yu, Zixu, Levorato, Marco
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Cross-Attention Speculative Decoding
por: Zhong, Wei, et al.
Publicado: (2025)

Multi-Candidate Speculative Decoding
por: Yang, Sen, et al.
Publicado: (2024)

Speculative Contrastive Decoding
por: Yuan, Hongyi, et al.
Publicado: (2023)

Speculative Decoding with a Speculative Vocabulary
por: Williams, Miles, et al.
Publicado: (2026)

Multi-Drafter Speculative Decoding with Alignment Feedback
por: Kim, Taehyeon, et al.
Publicado: (2026)

The Disparate Impacts of Speculative Decoding
por: Sandler, Jameson, et al.
Publicado: (2025)

Decoding Speculative Decoding
por: Yan, Minghao, et al.
Publicado: (2024)

Speculative Decoding for Multi-Sample Inference
por: Li, Yiwei, et al.
Publicado: (2025)

Cacheback: Speculative Decoding With Nothing But Cache
por: Ma, Zhiyao, et al.
Publicado: (2025)

A Multi-Model Adaptation of Speculative Decoding for Classification
por: Roy, Somnath, et al.
Publicado: (2025)

PACER: Blockwise Pre-verification for Speculative Decoding with Adaptive Length
por: Zhang, Situo, et al.
Publicado: (2026)

Speculative Decoding: Performance or Illusion?
por: Liu, Xiaoxuan, et al.
Publicado: (2025)

Speculative Pipeline Decoding: Higher-Accruacy and Zero-Bubble Speculation via Pipeline Parallelism
por: Yu, Yijiong, et al.
Publicado: (2026)

Graph-Structured Speculative Decoding
por: Gong, Zhuocheng, et al.
Publicado: (2024)

3-Model Speculative Decoding
por: Byun, Sanghyun, et al.
Publicado: (2025)

Dynamic Depth Decoding: Faster Speculative Decoding for LLMs
por: Brown, Oscar, et al.
Publicado: (2024)

DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting
por: Lv, Kai, et al.
Publicado: (2025)

Speculative Verification: Exploiting Information Gain to Refine Speculative Decoding
por: Kim, Sungkyun, et al.
Publicado: (2025)

Entropy-Aware Speculative Decoding Toward Improved LLM Reasoning
por: Su, Tiancheng, et al.
Publicado: (2025)

Towards Optimal Multi-draft Speculative Decoding
por: Hu, Zhengmian, et al.
Publicado: (2025)

AdaEAGLE: Optimizing Speculative Decoding via Explicit Modeling of Adaptive Draft Structures
por: Zhang, Situo, et al.
Publicado: (2024)

Dynamic Speculation Lookahead Accelerates Speculative Decoding of Large Language Models
por: Mamou, Jonathan, et al.
Publicado: (2024)

Learning to Draft: Adaptive Speculative Decoding with Reinforcement Learning
por: Zhang, Jiebin, et al.
Publicado: (2026)

Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation
por: Ouyang, Siru, et al.
Publicado: (2024)

Hybrid Verified Decoding: Learning to Allocate Verification in Speculative Decoding
por: Su, Xin, et al.
Publicado: (2026)

Self-Speculative Biased Decoding for Faster Re-Translation
por: Zeng, Linxiao, et al.
Publicado: (2025)

Constrained Decoding with Speculative Lookaheads
por: Nakshatri, Nishanth, et al.
Publicado: (2024)

Speculative Decoding Across Languages
por: Paudel, Nirajan, et al.
Publicado: (2026)

Scaling Laws for Speculative Decoding
por: Yan, Siyuan, et al.
Publicado: (2025)

Mamba Drafters for Speculative Decoding
por: Choi, Daewon, et al.
Publicado: (2025)

SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding
por: Sun, Ryan, et al.
Publicado: (2024)

DistillSpec: Improving Speculative Decoding via Knowledge Distillation
por: Zhou, Yongchao, et al.
Publicado: (2023)

Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity
por: Metel, Michael R., et al.
Publicado: (2024)

AdaSD: Adaptive Speculative Decoding for Efficient Language Model Inference
por: Lu, Kuan-Wei, et al.
Publicado: (2025)

CLaSp: In-Context Layer Skip for Self-Speculative Decoding
por: Chen, Longze, et al.
Publicado: (2025)

Goose: Anisotropic Speculation Trees for Training-Free Speculative Decoding
por: Jin, Tao, et al.
Publicado: (2026)

SpecTr-GBV: Multi-Draft Block Verification Accelerating Speculative Decoding
por: Lin, Yijun, et al.
Publicado: (2026)

Online Speculative Decoding
por: Liu, Xiaoxuan, et al.
Publicado: (2023)

NanoSpec: Accelerating Speculative Decoding using Minimalist In-Context Vocabularies
por: Chen, Zhiyang, et al.
Publicado: (2026)

PSD: Pushing the Pareto Frontier of Diffusion LLMs via Parallel Speculative Decoding
por: Sun, Shengyin, et al.
Publicado: (2026)