Efficient Prompt Compression with Evaluator Heads for Long-Context Transformer Inference

Documenti analoghi

• Retrieval Meets Reasoning: Dynamic In-Context Editing for Long-Text Understanding
  di: Fei, Weizhi, et al.
  Pubblicazione: (2024)
• Characterizing Prompt Compression Methods for Long Context Inference
  di: Jha, Siddharth, et al.
  Pubblicazione: (2024)
• DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  di: Xiao, Guangxuan, et al.
  Pubblicazione: (2024)
• ZigzagAttention: Efficient Long-Context Inference with Exclusive Retrieval and Streaming Heads
  di: Liu, Zhuorui, et al.
  Pubblicazione: (2025)
• ChunkKV: Semantic-Preserving KV Cache Compression for Efficient Long-Context LLM Inference
  di: Liu, Xiang, et al.
  Pubblicazione: (2025)