QUOKA: Query-Oriented KV Selection For Efficient LLM Prefill

Documenti analoghi

• CAOTE: KV Cache Selection for LLMs via Attention Output Error-Based Token Eviction
  di: Goel, Raghavv, et al.
  Pubblicazione: (2025)
• Fast Forward: Accelerating LLM Prefill with Predictive FFN Sparsity
  di: Gautam, Aayush, et al.
  Pubblicazione: (2026)
• KeyDiff: Key Similarity-Based KV Cache Eviction for Long-Context LLM Inference in Resource-Constrained Environments
  di: Park, Junyoung, et al.
  Pubblicazione: (2025)
• Recursive Speculative Decoding: Accelerating LLM Inference via Sampling Without Replacement
  di: Jeon, Wonseok, et al.
  Pubblicazione: (2024)
• On Speculative Decoding for Multimodal Large Language Models
  di: Gagrani, Mukul, et al.
  Pubblicazione: (2024)