Image de couverture de livre

SPEED: Speculative Pipelined Execution for Efficient Decoding

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Hooper, Coleman, Kim, Sehoon, Mohammadzadeh, Hiva, Genc, Hasan, Keutzer, Kurt, Gholami, Amir, Shao, Sophia
Format:	Preprint
Publié:	2023
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Squeezed Attention: Accelerating Long Context Length LLM Inference
par: Hooper, Coleman, et autres
Publié: (2024)

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
par: Hooper, Coleman, et autres
Publié: (2024)

Multipole Attention for Efficient Long Context Reasoning
par: Hooper, Coleman, et autres
Publié: (2025)

SqueezeLLM: Dense-and-Sparse Quantization
par: Kim, Sehoon, et autres
Publié: (2023)

Learned Best-Effort LLM Serving
par: Jha, Siddharth, et autres
Publié: (2024)

Characterizing Prompt Compression Methods for Long Context Inference
par: Jha, Siddharth, et autres
Publié: (2024)

Arbitrage: Efficient Reasoning via Advantage-Aware Speculation
par: Maheswaran, Monishwaran, et autres
Publié: (2025)

AI and Memory Wall
par: Gholami, Amir, et autres
Publié: (2024)

TinyAgent: Function Calling at the Edge
par: Erdogan, Lutfi Eren, et autres
Publié: (2024)

Efficient and Scalable Estimation of Tool Representations in Vector Space
par: Moon, Suhong, et autres
Publié: (2024)

CDLM: Consistency Diffusion Language Models For Faster Sampling
par: Kim, Minseo, et autres
Publié: (2025)

QuantSpec: Self-Speculative Decoding with Hierarchical Quantized KV Cache
par: Tiwari, Rishabh, et autres
Publié: (2025)

An LLM Compiler for Parallel Function Calling
par: Kim, Sehoon, et autres
Publié: (2023)

Beyond Next-Token Prediction: A Performance Characterization of Diffusion versus Autoregressive Language Models
par: Kim, Minseo, et autres
Publié: (2025)

Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks
par: Erdogan, Lutfi Eren, et autres
Publié: (2025)

LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
par: Lee, Nicholas, et autres
Publié: (2024)

ETS: Efficient Tree Search for Inference-Time Scaling
par: Hooper, Coleman, et autres
Publié: (2025)

Speculative Interaction Agents: Building Real-Time Agents with Asynchronous I/O and Speculative Tool Calling
par: Hooper, Coleman, et autres
Publié: (2026)

Speculative Pipeline Decoding: Higher-Accruacy and Zero-Bubble Speculation via Pipeline Parallelism
par: Yu, Yijiong, et autres
Publié: (2026)

LoSA: Locality Aware Sparse Attention for Block-Wise Diffusion Language Models
par: Xi, Haocheng, et autres
Publié: (2026)

Residual Context Diffusion Language Models
par: Hu, Yuezhou, et autres
Publié: (2026)

MITRA: A Large-Scale Parallel Corpus and Multilingual Pretrained Language Model for Machine Translation and Semantic Retrieval for Pāli, Sanskrit, Buddhist Chinese, and Tibetan
par: Nehrdich, Sebastian, et autres
Publié: (2026)

Pipeline Parallelism is All You Need for Optimized Early-Exit Based Self-Speculative Decoding
par: Li, Ruanjun, et autres
Publié: (2025)

Speculative Verification: Exploiting Information Gain to Refine Speculative Decoding
par: Kim, Sungkyun, et autres
Publié: (2025)

Accelerating Mobile Language Model via Speculative Decoding and NPU-Coordinated Execution
par: Chen, Zhiyang, et autres
Publié: (2025)

Agentic Test-Time Scaling for WebAgents
par: Lee, Nicholas, et autres
Publié: (2026)

Speculative Decoding with a Speculative Vocabulary
par: Williams, Miles, et autres
Publié: (2026)

Efficient Speculative Decoding for Llama at Scale: Challenges and Solutions
par: Tang, Bangsheng, et autres
Publié: (2025)

Scaling Speculative Decoding with Lookahead Reasoning
par: Fu, Yichao, et autres
Publié: (2025)

Decoding Speculative Decoding
par: Yan, Minghao, et autres
Publié: (2024)

CREST: Effectively Compacting a Datastore For Retrieval-Based Speculative Decoding
par: Ho, Sophia, et autres
Publié: (2024)

Tutorial Proposal: Speculative Decoding for Efficient LLM Inference
par: Xia, Heming, et autres
Publié: (2025)

Multi-Drafter Speculative Decoding with Alignment Feedback
par: Kim, Taehyeon, et autres
Publié: (2026)

Speculative Contrastive Decoding
par: Yuan, Hongyi, et autres
Publié: (2023)

Mamba Drafters for Speculative Decoding
par: Choi, Daewon, et autres
Publié: (2025)

Closer Look at Efficient Inference Methods: A Survey of Speculative Decoding
par: Ryu, Hyun, et autres
Publié: (2024)

HeteroSpec: Leveraging Contextual Heterogeneity for Efficient Speculative Decoding
par: Liu, Siran, et autres
Publié: (2025)

Simple and Effective Input Reformulations for Translation
par: Yu, Brian, et autres
Publié: (2023)

One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP Tasks
par: Nehrdich, Sebastian, et autres
Publié: (2024)

Multi-Candidate Speculative Decoding
par: Yang, Sen, et autres
Publié: (2024)