Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference

Documenti analoghi

• Prompt-prompted Adaptive Structured Pruning for Efficient LLM Generation
  di: Dong, Harry, et al.
  Pubblicazione: (2024)
• Scalable LLM Reasoning Acceleration with Low-rank Distillation
  di: Dong, Harry, et al.
  Pubblicazione: (2025)
• KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inference
  di: Tian, Yuxuan, et al.
  Pubblicazione: (2025)
• FreeKV: Boosting KV Cache Retrieval for Efficient LLM Inference
  di: Liu, Guangda, et al.
  Pubblicazione: (2025)
• SmallKV: Small Model Assisted Compensation of KV Cache Compression for Efficient LLM Inference
  di: Zhao, Yi, et al.
  Pubblicazione: (2025)