Image de couverture de livre

Confidence-Modulated Speculative Decoding for Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Sen, Jaydip, Dasgupta, Subhasis, Waghela, Hetvi
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Context-Enhanced Contrastive Search for Improved LLM Text Generation
par: Sen, Jaydip, et autres
Publié: (2025)

Multi-Amateur Contrastive Decoding for Text Generation
par: Sen, Jaydip, et autres
Publié: (2025)

Enhancing Adversarial Text Attacks on BERT Models with Projected Gradient Descent
par: Waghela, Hetvi, et autres
Publié: (2024)

A Modified Word Saliency-Based Adversarial Attack on Text Classification Models
par: Waghela, Hetvi, et autres
Publié: (2024)

Saliency Attention and Semantic Similarity-Driven Adversarial Perturbation
par: Waghela, Hetvi, et autres
Publié: (2024)

Adversarial Text Generation with Dynamic Contextual Perturbation
par: Waghela, Hetvi, et autres
Publié: (2025)

Advancing Decoding Strategies: Enhancements in Locally Typical Sampling for LLMs
par: Sen, Jaydip, et autres
Publié: (2025)

Analyzing Consumer Reviews for Understanding Drivers of Hotels Ratings: An Indian Perspective
par: Dasgupta, Subhasis, et autres
Publié: (2024)

Exploring Sectoral Profitability in the Indian Stock Market Using Deep Learning
par: Sen, Jaydip, et autres
Publié: (2024)

On Speculative Decoding for Multimodal Large Language Models
par: Gagrani, Mukul, et autres
Publié: (2024)

Fast Large Language Model Collaborative Decoding via Speculation
par: Fu, Jiale, et autres
Publié: (2025)

Adversarial Robustness through Dynamic Ensemble Learning
par: Waghela, Hetvi, et autres
Publié: (2024)

Hierarchical Verification of Speculative Beams for Accelerating LLM Inference
par: Sen, Jaydip, et autres
Publié: (2025)

Pruning as a Defense: Reducing Memorization in Large Language Models
par: Gupta, Mansi, et autres
Publié: (2025)

Understanding the Impact of News Articles on the Movement of Market Index: A Case on Nifty 50
par: Dasgupta, Subhasis, et autres
Publié: (2024)

Online Speculative Decoding
par: Liu, Xiaoxuan, et autres
Publié: (2023)

Mixture of Attentions For Speculative Decoding
par: Zimmer, Matthieu, et autres
Publié: (2024)

Traversal Verification for Speculative Tree Decoding
par: Weng, Yepeng, et autres
Publié: (2025)

Faster Cascades via Speculative Decoding
par: Narasimhan, Harikrishna, et autres
Publié: (2024)

A Comparative Study of Hyperparameter Tuning Methods
par: Dasgupta, Subhasis, et autres
Publié: (2024)

Confidence Under the Hood: An Investigation into the Confidence-Probability Alignment in Large Language Models
par: Kumar, Abhishek, et autres
Publié: (2024)

HiSpec: Hierarchical Speculative Decoding for LLMs
par: Kumar, Avinash, et autres
Publié: (2025)

Benchmarking the Energy Savings with Speculative Decoding Strategies
par: Dutta, Rohit, et autres
Publié: (2026)

A Theoretical Perspective for Speculative Decoding Algorithm
par: Yin, Ming, et autres
Publié: (2024)

Training Domain Draft Models for Speculative Decoding: Best Practices and Insights
par: Hong, Fenglu, et autres
Publié: (2025)

Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration
par: Wen, Zhuofan, et autres
Publié: (2024)

Data Privacy Preservation on the Internet of Things
par: Sen, Jaydip, et autres
Publié: (2023)

Self-Speculative Biased Decoding for Faster Re-Translation
par: Zeng, Linxiao, et autres
Publié: (2025)

Clover: Regressive Lightweight Speculative Decoding with Sequential Knowledge
par: Xiao, Bin, et autres
Publié: (2024)

Direct Alignment of Draft Model for Speculative Decoding with Chat-Fine-Tuned LLMs
par: Goel, Raghavv, et autres
Publié: (2024)

SpecBound: Adaptive Bounded Self-Speculation with Layer-wise Confidence Calibration
par: Wen, Zhuofan, et autres
Publié: (2026)

AdaSPEC: Selective Knowledge Distillation for Efficient Speculative Decoders
par: Hu, Yuezhou, et autres
Publié: (2025)

POSS: Position Specialist Generates Better Draft for Speculative Decoding
par: Huang, Langlin, et autres
Publié: (2025)

DistillSpec: Improving Speculative Decoding via Knowledge Distillation
par: Zhou, Yongchao, et autres
Publié: (2023)

Clover-2: Accurate Inference for Regressive Lightweight Speculative Decoding
par: Xiao, Bin, et autres
Publié: (2024)

DynaSpec: Context-aware Dynamic Speculative Sampling for Large-Vocabulary Language Models
par: Zhang, Jinbin, et autres
Publié: (2025)

Large Language Model Confidence Estimation via Black-Box Access
par: Pedapati, Tejaswini, et autres
Publié: (2024)

FR-Spec: Accelerating Large-Vocabulary Language Models via Frequency-Ranked Speculative Sampling
par: Zhao, Weilin, et autres
Publié: (2025)

Spiffy: Multiplying Diffusion LLM Acceleration via Lossless Speculative Decoding
par: Agrawal, Sudhanshu, et autres
Publié: (2025)

ML-SpecQD: Multi-Level Speculative Decoding with Quantized Drafts
par: Georganas, Evangelos, et autres
Publié: (2025)