NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention

Documenti analoghi

• Scout Before You Attend: Sketch-and-Walk Sparse Attention for Efficient LLM Inference
  di: Le, Hoang Anh Duy, et al.
  Pubblicazione: (2026)
• KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization
  di: Zhang, Tianyi, et al.
  Pubblicazione: (2024)
• To Compress or Not? Pushing the Frontier of Lossless GenAI Model Weights Compression with Exponent Concentration
  di: Yang, Zeyu, et al.
  Pubblicazione: (2025)
• RACE Attention: A Strictly Linear-Time Attention Layer for Training on Outrageously Large Contexts
  di: Joshi, Sahil, et al.
  Pubblicazione: (2025)
• Star Attention: Efficient LLM Inference over Long Sequences
  di: Acharya, Shantanu, et al.
  Pubblicazione: (2024)