Imagen de Portada

Reject Only Critical Tokens: Pivot-Aware Speculative Decoding

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ziashahabi, Amir, Bakman, Yavuz Faruk, Yaldiz, Duygu Nur, El-Khamy, Mostafa, Karimireddy, Sai Praneeth, Avestimehr, Salman
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Hair-Trigger Alignment: Black-Box Evaluation Cannot Guarantee Post-Update Alignment
por: Bakman, Yavuz, et al.
Publicado: (2026)

Uncertainty Quantification for Hallucination Detection in Large Language Models: Foundations, Methodology, and Future Directions
por: Kang, Sungmin, et al.
Publicado: (2025)

MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs
por: Bakman, Yavuz Faruk, et al.
Publicado: (2024)

Conformal Prediction Adaptive to Unknown Subpopulation Shifts
por: Wang, Nien-Shao, et al.
Publicado: (2025)

Reconsidering LLM Uncertainty Estimation Methods in the Wild
por: Bakman, Yavuz, et al.
Publicado: (2025)

Un-considering Contextual Information: Assessing LLMs' Understanding of Indexical Elements
por: Oguz, Metehan, et al.
Publicado: (2025)

Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs
por: Yaldiz, Duygu Nur, et al.
Publicado: (2024)

Uncertainty as Feature Gaps: Epistemic Uncertainty Quantification of LLMs in Contextual Question-Answering
por: Bakman, Yavuz, et al.
Publicado: (2025)

TruthTorchLM: A Comprehensive Library for Predicting Truthfulness in LLM Outputs
por: Yaldiz, Duygu Nur, et al.
Publicado: (2025)

CroMo-Mixup: Augmenting Cross-Model Representations for Continual Self-Supervised Learning
por: Mushtaq, Erum, et al.
Publicado: (2024)

GeoToken: Hierarchical Geolocalization of Images via Next Token Prediction
por: Ghasemi, Narges, et al.
Publicado: (2025)

Understanding Communication Backends in Cross-Silo Federated Learning
por: Ziashahabi, Amir, et al.
Publicado: (2026)

HARMONY: Hidden Activation Representations and Model Output-Aware Uncertainty Estimation for Vision-Language Models
por: Mushtaq, Erum, et al.
Publicado: (2025)

Do LLMs Recognize me, When I is not me: Assessment of LLMs Understanding of Turkish Indexical Pronouns in Indexical Shift Contexts
por: Oğuz, Metehan, et al.
Publicado: (2024)

Hawk: Accurate and Fast Privacy-Preserving Machine Learning Using Secure Lookup Table Computation
por: Saleem, Hamza, et al.
Publicado: (2024)

Open Vocabulary Panoptic Segmentation With Retrieval Augmentation
por: Sadeq, Nafis, et al.
Publicado: (2026)

Beyond URLs: Metadata Diversity and Position for Efficient LLM Pretraining
por: Fan, Dongyang, et al.
Publicado: (2025)

Fast Best-of-N Decoding via Speculative Rejection
por: Sun, Hanshi, et al.
Publicado: (2024)

Optimization with Access to Auxiliary Information
por: Chayti, El Mahdi, et al.
Publicado: (2022)

MobiZO: Enabling Efficient LLM Fine-Tuning at the Edge via Inference Engines
por: Gao, Lei, et al.
Publicado: (2024)

TALON: Confidence-Aware Speculative Decoding with Adaptive Token Trees
por: Liu, Tianyu, et al.
Publicado: (2026)

A Systematic Analysis of Base Model Choice for Reward Modeling
por: Ahrabian, Kian, et al.
Publicado: (2025)

Renormalization Group flow, Optimal Transport and Diffusion-based Generative Model
por: Sheshmani, Artan, et al.
Publicado: (2024)

From Tokens to Steps: Verification-Aware Speculative Decoding for Efficient Multi-Step Reasoning
por: Purohit, Kiran, et al.
Publicado: (2026)

Beyond Tokens: Semantic-Aware Speculative Decoding for Efficient Inference by Probing Internal States
por: Dong, Ximing, et al.
Publicado: (2026)

OSMGen: Highly Controllable Satellite Image Synthesis using OpenStreetMap Data
por: Ziashahabi, Amir, et al.
Publicado: (2025)

GRIFFIN: Effective Token Alignment for Faster Speculative Decoding
por: Hu, Shijing, et al.
Publicado: (2025)

LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation
por: Liu, Tianyu, et al.
Publicado: (2025)

Speculative Decoding and Beyond: An In-Depth Survey of Techniques
por: Hu, Yunhai, et al.
Publicado: (2025)

Efficient Adaptive Rejection Sampling for Accelerating Speculative Decoding in Large Language Models
por: Sun, Chendong, et al.
Publicado: (2025)

OpaqueToolsBench: Learning Nuances of Tool Behavior Through Interaction
por: Hallinan, Skyler, et al.
Publicado: (2026)

TETRIS: Optimal Draft Token Selection for Batch Speculative Decoding
por: Wu, Zhaoxuan, et al.
Publicado: (2025)

Training-free Dropout Sampling for Semantic Token Acceptance in Speculative Decoding
por: Lee, Jeongtae, et al.
Publicado: (2026)

Revisiting OPRO: The Limitations of Small-Scale LLMs as Optimizers
por: Zhang, Tuo, et al.
Publicado: (2024)

SPEED: Speculative Pipelined Execution for Efficient Decoding
por: Hooper, Coleman, et al.
Publicado: (2023)

Cost-Aware Diffusion Draft Trees for Speculative Decoding
por: Zhang, Shuai, et al.
Publicado: (2026)

Speculative Decoding with a Speculative Vocabulary
por: Williams, Miles, et al.
Publicado: (2026)

Decoding Speculative Decoding
por: Yan, Minghao, et al.
Publicado: (2024)

ContextLeak: Auditing Leakage in Private In-Context Learning Methods
por: Choi, Jacob, et al.
Publicado: (2025)

SDSAT: Accelerating LLM Inference through Speculative Decoding with Semantic Adaptive Tokens
por: Liu, Chengbo, et al.
Publicado: (2024)