Polar Sparsity: High Throughput Batched LLM Inferencing with Scalable Contextual Sparsity

Documenti analoghi

• Token-Driven GammaTune: Adaptive Calibration for Enhanced Speculative Decoding
  di: Gautam, Aayush, et al.
  Pubblicazione: (2025)
• Fast Forward: Accelerating LLM Prefill with Predictive FFN Sparsity
  di: Gautam, Aayush, et al.
  Pubblicazione: (2026)
• ShadowLLM: Predictor-based Contextual Sparsity for Large Language Models
  di: Akhauri, Yash, et al.
  Pubblicazione: (2024)
• S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity
  di: Yang, Xinyu, et al.
  Pubblicazione: (2024)
• HashAttention: Semantic Sparsity for Faster Inference
  di: Desai, Aditya, et al.
  Pubblicazione: (2024)