Imagen de Portada

Nearest Neighbor Speculative Decoding for LLM Generation and Attribution

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Minghan, Chen, Xilun, Holtzman, Ari, Chen, Beidi, Lin, Jimmy, Yih, Wen-tau, Lin, Xi Victoria
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

DRAMA: Diverse Augmentation from Large Language Models to Smaller Dense Retrievers
por: Ma, Xueguang, et al.
Publicado: (2025)

Few-Shot Data Synthesis for Open Domain Multi-Hop Question Answering
por: Chen, Mingda, et al.
Publicado: (2023)

FLAME: Factuality-Aware Alignment for Large Language Models
por: Lin, Sheng-Chieh, et al.
Publicado: (2024)

ImpRAG: Retrieval-Augmented Generation with Implicit Queries
por: Zhang, Wenzheng, et al.
Publicado: (2025)

SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices
por: Svirschevski, Ruslan, et al.
Publicado: (2024)

KNN-SSD: Enabling Dynamic Self-Speculative Decoding via Nearest Neighbor Layer Set Optimization
por: Song, Mingbo, et al.
Publicado: (2025)

TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
por: Sun, Hanshi, et al.
Publicado: (2024)

Linearly Decoding Refused Knowledge in Aligned Language Models
por: Shrivastava, Aryan, et al.
Publicado: (2025)

Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding
por: Chen, Zhuoming, et al.
Publicado: (2024)

Learning to Reason for Factuality
por: Chen, Xilun, et al.
Publicado: (2025)

SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models
por: Chuang, Yung-Sung, et al.
Publicado: (2025)

Procedural Knowledge at Scale Improves Reasoning
por: Wu, Di, et al.
Publicado: (2026)

MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding
por: Sadhukhan, Ranajoy, et al.
Publicado: (2024)

LLM Probability Concentration: How Alignment Shrinks the Generative Horizon
por: Yang, Chenghao, et al.
Publicado: (2025)

Anchored Decoding: Provably Reducing Copyright Risk for Any Language Model
por: He, Jacqueline, et al.
Publicado: (2026)

Reliable, Adaptable, and Attributable Language Models with Retrieval
por: Asai, Akari, et al.
Publicado: (2024)

SCRIBES: Web-Scale Script-Based Semi-Structured Data Extraction with Reinforcement Learning
por: Liu, Shicheng, et al.
Publicado: (2025)

Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
por: Sukhbaatar, Sainbayar, et al.
Publicado: (2024)

Learning Facts at Scale with Active Reading
por: Lin, Jessy, et al.
Publicado: (2025)

Speculative Prefill: Turbocharging TTFT with Lightweight and Training-Free Token Importance Estimation
por: Liu, Jingyu, et al.
Publicado: (2025)

Prompting as Scientific Inquiry
por: Holtzman, Ari, et al.
Publicado: (2025)

Sirius: Contextual Sparsity with Correction for Efficient LLMs
por: Zhou, Yang, et al.
Publicado: (2024)

Towards Faster k-Nearest-Neighbor Machine Translation
por: Shi, Xiangyu, et al.
Publicado: (2023)

FACTORY: A Challenging Human-Verified Prompt Set for Long-Form Factuality
por: Chen, Mingda, et al.
Publicado: (2025)

Instruction-tuned Language Models are Better Knowledge Learners
por: Jiang, Zhengbao, et al.
Publicado: (2024)

Knowledge Extraction on Semi-Structured Content: Does It Remain Relevant for Question Answering in the Era of LLMs?
por: Sun, Kai, et al.
Publicado: (2025)

DART: Diffusion-Inspired Speculative Decoding for Fast LLM Inference
por: Liu, Fuliang, et al.
Publicado: (2026)

Scaling Up, Speeding Up: A Benchmark of Speculative Decoding for Efficient LLM Test-Time Scaling
por: Sun, Shengyin, et al.
Publicado: (2025)

Cacheback: Speculative Decoding With Nothing But Cache
por: Ma, Zhiyao, et al.
Publicado: (2025)

Tutorial Proposal: Speculative Decoding for Efficient LLM Inference
por: Xia, Heming, et al.
Publicado: (2025)

PSD: Pushing the Pareto Frontier of Diffusion LLMs via Parallel Speculative Decoding
por: Sun, Shengyin, et al.
Publicado: (2026)

Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
por: Liang, Weixin, et al.
Publicado: (2024)

Unveiling the Mystery of Visual Attributes of Concrete and Abstract Concepts: Variability, Nearest Neighbors, and Challenging Categories
por: Tater, Tarun, et al.
Publicado: (2024)

Multi-Candidate Speculative Decoding
por: Yang, Sen, et al.
Publicado: (2024)

Speculative Decoding with a Speculative Vocabulary
por: Williams, Miles, et al.
Publicado: (2026)

NNOSE: Nearest Neighbor Occupational Skill Extraction
por: Zhang, Mike, et al.
Publicado: (2024)

Prompt-prompted Adaptive Structured Pruning for Efficient LLM Generation
por: Dong, Harry, et al.
Publicado: (2024)

An Early FIRST Reproduction and Improvements to Single-Token Decoding for Fast Listwise Reranking
por: Chen, Zijian, et al.
Publicado: (2024)

SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
por: Xia, Heming, et al.
Publicado: (2024)

Improving Factuality with Explicit Working Memory
por: Chen, Mingda, et al.
Publicado: (2024)