Accelerating Sparse Transformer Inference on GPU

Documenti analoghi

• QUARK: Quantization-Enabled Circuit Sharing for Transformer Acceleration by Exploiting Common Patterns in Nonlinear Operations
  di: Zhao, Zhixiong, et al.
  Pubblicazione: (2025)
• ESACT: An End-to-End Sparse Accelerator for Compute-Intensive Transformers via Local Similarity
  di: Liu, Hongxiang, et al.
  Pubblicazione: (2025)
• DASH: Input-Aware Dynamic Layer Skipping for Efficient LLM Inference with Markov Decision Policies
  di: Yang, Ning, et al.
  Pubblicazione: (2025)
• GPU-Accelerated Optimization of Transformer-Based Neural Networks for Real-Time Inference
  di: Mukherjee, Soutrik, et al.
  Pubblicazione: (2026)
• xGR: Efficient Generative Recommendation Serving at Scale
  di: Sun, Qingxiao, et al.
  Pubblicazione: (2025)