Imagen de Portada

Confidence-Modulated Speculative Decoding for Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Sen, Jaydip, Dasgupta, Subhasis, Waghela, Hetvi
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Context-Enhanced Contrastive Search for Improved LLM Text Generation
por: Sen, Jaydip, et al.
Publicado: (2025)

Multi-Amateur Contrastive Decoding for Text Generation
por: Sen, Jaydip, et al.
Publicado: (2025)

Enhancing Adversarial Text Attacks on BERT Models with Projected Gradient Descent
por: Waghela, Hetvi, et al.
Publicado: (2024)

A Modified Word Saliency-Based Adversarial Attack on Text Classification Models
por: Waghela, Hetvi, et al.
Publicado: (2024)

Saliency Attention and Semantic Similarity-Driven Adversarial Perturbation
por: Waghela, Hetvi, et al.
Publicado: (2024)

Adversarial Text Generation with Dynamic Contextual Perturbation
por: Waghela, Hetvi, et al.
Publicado: (2025)

Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs
por: Sen, Jaydip, et al.
Publicado: (2025)

Analyzing Consumer Reviews for Understanding Drivers of Hotels Ratings: An Indian Perspective
por: Dasgupta, Subhasis, et al.
Publicado: (2024)

Exploring Sectoral Profitability in the Indian Stock Market Using Deep Learning
por: Sen, Jaydip, et al.
Publicado: (2024)

On Speculative Decoding for Multimodal Large Language Models
por: Gagrani, Mukul, et al.
Publicado: (2024)

Fast Large Language Model Collaborative Decoding via Speculation
por: Fu, Jiale, et al.
Publicado: (2025)

Adversarial Robustness through Dynamic Ensemble Learning
por: Waghela, Hetvi, et al.
Publicado: (2024)

Hierarchical Verification of Speculative Beams for Accelerating LLM Inference
por: Sen, Jaydip, et al.
Publicado: (2025)

Pruning as a Defense: Reducing Memorization in Large Language Models
por: Gupta, Mansi, et al.
Publicado: (2025)

Understanding the Impact of News Articles on the Movement of Market Index: A Case on Nifty 50
por: Dasgupta, Subhasis, et al.
Publicado: (2024)

Online Speculative Decoding
por: Liu, Xiaoxuan, et al.
Publicado: (2023)

Mixture of Attentions For Speculative Decoding
por: Zimmer, Matthieu, et al.
Publicado: (2024)

Traversal Verification for Speculative Tree Decoding
por: Weng, Yepeng, et al.
Publicado: (2025)

Faster Cascades via Speculative Decoding
por: Narasimhan, Harikrishna, et al.
Publicado: (2024)

A Comparative Study of Hyperparameter Tuning Methods
por: Dasgupta, Subhasis, et al.
Publicado: (2024)

Confidence Under the Hood: An Investigation into the Confidence-Probability Alignment in Large Language Models
por: Kumar, Abhishek, et al.
Publicado: (2024)

HiSpec: Hierarchical Speculative Decoding for LLMs
por: Kumar, Avinash, et al.
Publicado: (2025)

Benchmarking the Energy Savings with Speculative Decoding Strategies
por: Dutta, Rohit, et al.
Publicado: (2026)

A Theoretical Perspective for Speculative Decoding Algorithm
por: Yin, Ming, et al.
Publicado: (2024)

Training Domain Draft Models for Speculative Decoding: Best Practices and Insights
por: Hong, Fenglu, et al.
Publicado: (2025)

Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration
por: Wen, Zhuofan, et al.
Publicado: (2024)

Data Privacy Preservation on the Internet of Things
por: Sen, Jaydip, et al.
Publicado: (2023)

Self-Speculative Biased Decoding for Faster Re-Translation
por: Zeng, Linxiao, et al.
Publicado: (2025)

Clover: Regressive Lightweight Speculative Decoding with Sequential Knowledge
por: Xiao, Bin, et al.
Publicado: (2024)

Direct Alignment of Draft Model for Speculative Decoding with Chat-Fine-Tuned LLMs
por: Goel, Raghavv, et al.
Publicado: (2024)

SpecBound: Adaptive Bounded Self-Speculation with Layer-wise Confidence Calibration
por: Wen, Zhuofan, et al.
Publicado: (2026)

AdaSPEC: Selective Knowledge Distillation for Efficient Speculative Decoders
por: Hu, Yuezhou, et al.
Publicado: (2025)

POSS: Position Specialist Generates Better Draft for Speculative Decoding
por: Huang, Langlin, et al.
Publicado: (2025)

DistillSpec: Improving Speculative Decoding via Knowledge Distillation
por: Zhou, Yongchao, et al.
Publicado: (2023)

Clover-2: Accurate Inference for Regressive Lightweight Speculative Decoding
por: Xiao, Bin, et al.
Publicado: (2024)

DynaSpec: Context-aware Dynamic Speculative Sampling for Large-Vocabulary Language Models
por: Zhang, Jinbin, et al.
Publicado: (2025)

Large Language Model Confidence Estimation via Black-Box Access
por: Pedapati, Tejaswini, et al.
Publicado: (2024)

FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling
por: Zhao, Weilin, et al.
Publicado: (2025)

Spiffy: Multiplying Diffusion LLM Acceleration via Lossless Speculative Decoding
por: Agrawal, Sudhanshu, et al.
Publicado: (2025)

ML-SpecQD: Multi-Level Speculative Decoding with Quantized Drafts
por: Georganas, Evangelos, et al.
Publicado: (2025)