Adamas: Hadamard Sparse Attention for Efficient Long-Context Inference

Documenti analoghi

• DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
  di: Xiao, Guangxuan, et al.
  Pubblicazione: (2024)
• FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  di: Lai, Xunhao, et al.
  Pubblicazione: (2025)
• Token Sparse Attention: Efficient Long-Context Inference with Interleaved Token Selection
  di: Jo, Dongwon, et al.
  Pubblicazione: (2026)
• MTraining: Distributed Dynamic Sparse Attention for Efficient Ultra-Long Context Training
  di: Li, Wenxuan, et al.
  Pubblicazione: (2025)
• S$^3$-Attention:Attention-Aligned Endogenous Retrieval for Memory-Bounded Long-Context Inference
  di: Ma, Qingsen, et al.
  Pubblicazione: (2026)