:: Library Catalog

Image de couverture de livre

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Xiong, Yunfan, Zhang, Ruoyu, Li, Yanzeng, Wu, Tianhao, Zou, Lei
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	https://arxiv.org/abs/2410.11744
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

ParallelSpec: Parallel Drafter for Efficient Speculative Decoding
par: Xiao, Zilin, et autres
Publié: (2024)

MoE-Spec: Expert Budgeting for Efficient Speculative Decoding
par: McDanel, Bradley, et autres
Publié: (2026)

EasySpec: Layer-Parallel Speculative Decoding for Efficient Multi-GPU Utilization
par: Wu, Yize, et autres
Publié: (2025)

SpecPipe: Accelerating Pipeline Parallelism-based LLM Inference with Speculative Decoding
par: Yin, Haofei, et autres
Publié: (2025)

HiSpec: Hierarchical Speculative Decoding for LLMs
par: Kumar, Avinash, et autres
Publié: (2025)

TriSpec: Ternary Speculative Decoding via Lightweight Proxy Verification
par: Jiang, Haoyun, et autres
Publié: (2026)

BanditSpec: Adaptive Speculative Decoding via Bandit Algorithms
par: Hou, Yunlong, et autres
Publié: (2025)

SpecMemo: Speculative Decoding is in Your Pocket
par: Yildirim, Selin, et autres
Publié: (2025)

Faster Cascades via Speculative Decoding
par: Narasimhan, Harikrishna, et autres
Publié: (2024)

ReSpec: Towards Optimizing Speculative Decoding in Reinforcement Learning Systems
par: Chen, Qiaoling, et autres
Publié: (2025)

SpecForge: A Flexible and Efficient Open-Source Training Framework for Speculative Decoding
par: Li, Shenggui, et autres
Publié: (2026)

SwiftSpec: Ultra-Low Latency LLM Decoding by Scaling Asynchronous Speculative Decoding
par: Zhang, Ziyi, et autres
Publié: (2025)

DistillSpec: Improving Speculative Decoding via Knowledge Distillation
par: Zhou, Yongchao, et autres
Publié: (2023)

SpecRouter: Adaptive Routing for Multi-Level Speculative Decoding in Large Language Models
par: Wu, Hang, et autres
Publié: (2025)

QuantSpec: Self-Speculative Decoding with Hierarchical Quantized KV Cache
par: Tiwari, Rishabh, et autres
Publié: (2025)

SpecMER: Fast Protein Generation with K-mer Guided Speculative Decoding
par: Walton, Thomas, et autres
Publié: (2025)

CAS-Spec: Cascade Adaptive Self-Speculative Decoding for On-the-Fly Lossless Inference Acceleration of LLMs
par: Ning, Zhiyuan, et autres
Publié: (2025)

Annealed Relaxation of Speculative Decoding for Faster Autoregressive Image Generation
par: Li, Xingyao, et autres
Publié: (2026)

SpecPV: Improving Self-Speculative Decoding for Long-Context Generation via Partial Verification
par: Tan, Zhendong, et autres
Publié: (2025)

LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
par: Yang, Penghui, et autres
Publié: (2025)

SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths
par: Huang, Kaixuan, et autres
Publié: (2024)

ML-SpecQD: Multi-Level Speculative Decoding with Quantized Drafts
par: Georganas, Evangelos, et autres
Publié: (2025)

SpecTr: Fast Speculative Decoding via Optimal Transport
par: Sun, Ziteng, et autres
Publié: (2023)

Spec-VLA: Speculative Decoding for Vision-Language-Action Models with Relaxed Acceptance
par: Wang, Songsheng, et autres
Publié: (2025)

SlimSpec: Low-Rank Draft LM-Head for Accelerated Speculative Decoding
par: Plaksin, Anton, et autres
Publié: (2026)

Self-Speculative Biased Decoding for Faster Re-Translation
par: Zeng, Linxiao, et autres
Publié: (2025)

Think Before You Accept: Semantic Reflective Verification for Faster Speculative Decoding
par: Wang, Yixuan, et autres
Publié: (2025)

Greedy Multi-Path Block Verification for Faster Decoding in Speculative Sampling
par: Thomas, Rahul, et autres
Publié: (2026)

SpecExtend: A Drop-in Enhancement for Speculative Decoding of Long Sequences
par: Cha, Jungyoub, et autres
Publié: (2025)

Speculative Speculative Decoding
par: Kumar, Tanishq, et autres
Publié: (2026)

KnapSpec: Self-Speculative Decoding via Adaptive Layer Selection as a Knapsack Problem
par: Cha, Seongjin, et autres
Publié: (2026)

SpecAttn: Speculating Sparse Attention
par: Shah, Harsh
Publié: (2025)

SpecKV: Adaptive Speculative Decoding with Compression-Aware Gamma Selection
par: Shukla, Shikhar
Publié: (2026)

Exploiting Prefix-Tree in Structured Output Interfaces for Enhancing Jailbreak Attacking
par: Li, Yanzeng, et autres
Publié: (2025)

Balancing Coverage and Draft Latency in Vocabulary Trimming for Faster Speculative Decoding
par: Shoham, Ofir Ben
Publié: (2026)

Judge Decoding: Faster Speculative Sampling Requires Going Beyond Model Alignment
par: Bachmann, Gregor, et autres
Publié: (2025)

Reject Only Critical Tokens: Pivot-Aware Speculative Decoding
par: Ziashahabi, Amir, et autres
Publié: (2025)

DynaSpec: Context-aware Dynamic Speculative Sampling for Large-Vocabulary Language Models
par: Zhang, Jinbin, et autres
Publié: (2025)

SpecMoE: A Fast and Efficient Mixture-of-Experts Inference via Self-Assisted Speculative Decoding
par: Bang, Jehyeon, et autres
Publié: (2026)

Gumiho: A Hybrid Architecture to Prioritize Early Tokens in Speculative Decoding
par: Li, Jinze, et autres
Publié: (2025)