Image de couverture de livre

Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhao, Yilong, Tang, Jiaming, Zhu, Kan, Ye, Zihao, Chang, Chi-Chih, Lin, Chaofan, Park, Jongseok, Xiao, Guangxuan, Abdelfattah, Mohamed S., Gao, Mingyu, Kasikci, Baris, Han, Song, Stoica, Ion
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Speculative Decoding: Performance or Illusion?
par: Liu, Xiaoxuan, et autres
Publié: (2025)

Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
par: Tang, Jiaming, et autres
Publié: (2024)

BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching
par: Zhao, Yilong, et autres
Publié: (2024)

Speculate Deep and Accurate: Lossless and Training-Free Acceleration for Offloaded LLMs via Substitute Speculative Decoding
par: Wang, Pei-Shuo, et autres
Publié: (2025)

Qrita: High-performance Top-k and Top-p using Pivot-based Truncation and Selection
par: Park, Jongseok, et autres
Publié: (2026)

Unleashing Scalable Context Parallelism for Foundation Models Pre-Training via FCP
par: Zhao, Yilong, et autres
Publié: (2026)

Online Speculative Decoding
par: Liu, Xiaoxuan, et autres
Publié: (2023)

Uncovering Intra-expert Activation Sparsity for Efficient Mixture-of-Expert Model Execution
par: Park, Jongseok, et autres
Publié: (2026)

SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding
par: Wang, Zhenglin, et autres
Publié: (2024)

SRT: Accelerating Reinforcement Learning via Speculative Rollout with Tree-Structured Cache
par: Chang, Chi-Chih, et autres
Publié: (2026)

Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models
par: Kamahori, Keisuke, et autres
Publié: (2024)

Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
par: Fu, Yichao, et autres
Publié: (2024)

Accelerate Speculative Decoding with Sparse Computation in Verification
par: Wang, Jikai, et autres
Publié: (2025)

Scaling Speculative Decoding with Lookahead Reasoning
par: Fu, Yichao, et autres
Publié: (2025)

Recursive Speculative Decoding: Accelerating LLM Inference via Sampling Without Replacement
par: Jeon, Wonseok, et autres
Publié: (2024)

Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
par: Zhao, Yilong, et autres
Publié: (2023)

Speculative Decoding for Multi-Sample Inference
par: Li, Yiwei, et autres
Publié: (2025)

TurboSpec: Closed-loop Speculation Control System for Optimizing LLM Serving Goodput
par: Liu, Xiaoxuan, et autres
Publié: (2024)

Some Present-Day Problems of Romanian Library Science
par: Stoica, Ion
Publié: (1973)

The Central University Library, Bucharest. Over Seventy-five Years in the History of a Collection
par: Stoica, Ion
Publié: (1972)

Twilight: Adaptive Attention Sparsity with Hierarchical Top-$p$ Pruning
par: Lin, Chaofan, et autres
Publié: (2025)

SpecDiff: Accelerating Diffusion Model Inference with Self-Speculation
par: Pan, Jiayi, et autres
Publié: (2025)

SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
par: Xia, Heming, et autres
Publié: (2024)

SpecMamba: Accelerating Mamba Inference on FPGA with Speculative Decoding
par: Zhong, Linfeng, et autres
Publié: (2025)

Accelerating OpenPangu Inference on NPU via Speculative Decoding
par: Dai, Yuntao, et autres
Publié: (2026)

Accelerating Autoregressive Speech Synthesis Inference With Speech Speculative Decoding
par: Lin, Zijian, et autres
Publié: (2025)

CAS-Spec: Cascade Adaptive Self-Speculative Decoding for On-the-Fly Lossless Inference Acceleration of LLMs
par: Ning, Zhiyuan, et autres
Publié: (2025)

PolyServe: Efficient Multi-SLO Serving at Scale
par: Zhu, Kan, et autres
Publié: (2025)

NITRO: LLM Inference on Intel Laptop NPUs
par: Fei, Anthony, et autres
Publié: (2024)

Accelerating Mixture-of-Experts Inference by Hiding Offloading Latency with Speculative Decoding
par: Wang, Zhibin, et autres
Publié: (2025)

Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration
par: Wen, Zhuofan, et autres
Publié: (2024)

Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies
par: Timor, Nadav, et autres
Publié: (2025)

SplitReason: Learning To Offload Reasoning
par: Akhauri, Yash, et autres
Publié: (2025)

Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation
par: Yang, Shuo, et autres
Publié: (2025)

MoESD: Unveil Speculative Decoding's Potential for Accelerating Sparse MoE
par: Huang, Zongle, et autres
Publié: (2025)

$\texttt{SPECS}$: Faster Test-Time Scaling through Speculative Drafts
par: Cemri, Mert, et autres
Publié: (2025)

DARE: Diffusion Language Model Activation Reuse for Efficient Inference
par: Frumkin, Natalia, et autres
Publié: (2026)

SpecFed: Accelerating Federated LLM Inference with Speculative Decoding and Compressed Transmission
par: Zheng, Ce, et autres
Publié: (2026)

SpecPipe: Accelerating Pipeline Parallelism-based LLM Inference with Speculative Decoding
par: Yin, Haofei, et autres
Publié: (2025)

Efficiency Unleashed: Inference Acceleration for LLM-based Recommender Systems with Speculative Decoding
par: Xi, Yunjia, et autres
Publié: (2024)