SDFP: Speculative Decoding with FIT-Pruned Models for Training-Free and Plug-and-Play LLM Acceleration

Documenti analoghi

• Dual LoRA: Enhancing LoRA with Magnitude and Direction Updates
  di: Xu, Yixing, et al.
  Pubblicazione: (2025)
• Forecasting LLM Inference Performance via Hardware-Agnostic Analytical Modeling
  di: Patwari, Rajeev, et al.
  Pubblicazione: (2025)
• Recover-LoRA: Data-Free Accuracy Recovery of Degraded Language Models via Low-Rank Adaptation
  di: Das, Devleena, et al.
  Pubblicazione: (2025)
• NGM: A Plug-and-Play Training-Free Memory Module for LLMs
  di: Qu, Yuwen, et al.
  Pubblicazione: (2026)
• Speculate Deep and Accurate: Lossless and Training-Free Acceleration for Offloaded LLMs via Substitute Speculative Decoding
  di: Wang, Pei-Shuo, et al.
  Pubblicazione: (2025)