Imagen de Portada

EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Yuhui, Wei, Fangyun, Zhang, Chao, Zhang, Hongyang
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
por: Li, Yuhui, et al.
Publicado: (2024)

EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test
por: Li, Yuhui, et al.
Publicado: (2025)

Cascade Speculative Drafting for Even Faster LLM Inference
por: Chen, Ziyi, et al.
Publicado: (2023)

FlashDecoding++: Faster Large Language Model Inference on GPUs
por: Hong, Ke, et al.
Publicado: (2023)

Faster MoE LLM Inference for Extremely Large Models
por: Yang, Haoqi, et al.
Publicado: (2025)

Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets
por: Li, Dongyue, et al.
Publicado: (2025)

$\texttt{SPECS}$: Faster Test-Time Scaling through Speculative Drafts
por: Cemri, Mert, et al.
Publicado: (2025)

Balancing Coverage and Draft Latency in Vocabulary Trimming for Faster Speculative Decoding
por: Shoham, Ofir Ben
Publicado: (2026)

PRISM: Parametrically Refactoring Inference for Speculative Sampling Draft Models
por: Wang, Xuliang, et al.
Publicado: (2026)

CDLM: Consistency Diffusion Language Models For Faster Sampling
por: Kim, Minseo, et al.
Publicado: (2025)

Inference-Cost-Aware Dynamic Tree Construction for Efficient Inference in Large Language Models
por: Hong, Yinrong, et al.
Publicado: (2025)

Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration
por: Wen, Zhuofan, et al.
Publicado: (2024)

Sparser, Faster, Lighter Transformer Language Models
por: Cetin, Edoardo, et al.
Publicado: (2026)

Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge
por: Shen, Xuan, et al.
Publicado: (2023)

Faster LLM Inference via Sequential Monte Carlo
por: Emara, Yahya, et al.
Publicado: (2026)

AnyTool: Self-Reflective, Hierarchical Agents for Large-Scale API Calls
por: Du, Yu, et al.
Publicado: (2024)

SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
por: Lu, Xudong, et al.
Publicado: (2024)

P-EAGLE: Parallel-Drafting EAGLE with Scalable Training
por: Hui, Mude, et al.
Publicado: (2026)

Distributed Speculative Inference (DSI): Speculation Parallelism for Provably Faster Lossless Language Model Inference
por: Timor, Nadav, et al.
Publicado: (2024)

First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models
por: Ma, Chi, et al.
Publicado: (2024)

When Latent Geometry Is Not Enough: Draft-Conditioned Latent Refinement for Non-Autoregressive Text Generation
por: Zhang, De Shuai
Publicado: (2026)

LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
por: Yang, Penghui, et al.
Publicado: (2025)

Not All Denoising Steps Are Equal: Model Scheduling for Faster Masked Diffusion Language Models
por: Sedykh, Ivan, et al.
Publicado: (2026)

BAQ: Efficient Bit Allocation Quantization for Large Language Models
por: Zhang, Chao, et al.
Publicado: (2025)

Weak-to-Strong Elicitation via Mismatched Wrong Drafts
por: Deng, Wei
Publicado: (2026)

Quantifying the Impact of Structured Output Format on Large Language Models through Causal Inference
por: Yuan, Han, et al.
Publicado: (2025)

TreePO: Bridging the Gap of Policy Optimization and Efficacy and Inference Efficiency with Heuristic Tree-based Modeling
por: Li, Yizhi, et al.
Publicado: (2025)

Scalable Fine-tuning from Multiple Data Sources: A First-Order Approximation Approach
por: Li, Dongyue, et al.
Publicado: (2024)

T1: Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling
por: Hou, Zhenyu, et al.
Publicado: (2025)

Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recycling
por: Luo, Xianzhen, et al.
Publicado: (2024)

Faster-GCG: Efficient Discrete Optimization Jailbreak Attacks against Aligned Large Language Models
por: Li, Xiao, et al.
Publicado: (2024)

Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inference
por: Song, Yuxuan, et al.
Publicado: (2025)

AdaSplash-2: Faster Differentiable Sparse Attention
por: Gonçalves, Nuno, et al.
Publicado: (2026)

Efficient Estimation of Kernel Surrogate Models for Task Attribution
por: Zhang, Zhenshuo, et al.
Publicado: (2026)

Sparser is Faster and Less is More: Efficient Sparse Attention for Long-Range Transformers
por: Lou, Chao, et al.
Publicado: (2024)

A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models
por: Wu, Yihan, et al.
Publicado: (2023)

OmniDraft: A Cross-vocabulary, Online Adaptive Drafter for On-device Speculative Decoding
por: Ramakrishnan, Ramchalam Kinattinkara, et al.
Publicado: (2025)

Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training
por: Wang, Yixuan, et al.
Publicado: (2024)

Causal Inference for Human-Language Model Collaboration
por: Zhang, Bohan, et al.
Publicado: (2024)

Training Domain Draft Models for Speculative Decoding: Best Practices and Insights
por: Hong, Fenglu, et al.
Publicado: (2025)