MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Documenti analoghi

• MMInference: Accelerating Pre-filling for Long-Context VLMs via Modality-Aware Permutation Sparse Attention
  di: Li, Yucheng, et al.
  Pubblicazione: (2025)
• SCBench: A KV Cache-Centric Analysis of Long-Context Methods
  di: Li, Yucheng, et al.
  Pubblicazione: (2024)
• LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression
  di: Jiang, Huiqiang, et al.
  Pubblicazione: (2023)
• MTraining: Distributed Dynamic Sparse Attention for Efficient Ultra-Long Context Training
  di: Li, Wenxuan, et al.
  Pubblicazione: (2025)
• SecurityLingua: Efficient Defense of LLM Jailbreak Attacks via Security-Aware Prompt Compression
  di: Li, Yucheng, et al.
  Pubblicazione: (2025)