Accelerating Transformer Pre-training with 2:4 Sparsity

Documenti analoghi

• CAST: Continuous and Differentiable Semi-Structured Sparsity-Aware Training for Large Language Models
  di: Huang, Weiyu, et al.
  Pubblicazione: (2025)
• S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training
  di: Hu, Yuezhou, et al.
  Pubblicazione: (2024)
• Identifying Sensitive Weights via Post-quantization Integral
  di: Hu, Yuezhou, et al.
  Pubblicazione: (2025)
• Deterministic Differentiable Structured Pruning for Large Language Models
  di: Huang, Weiyu, et al.
  Pubblicazione: (2026)
• SaberLDA: Sparsity-Aware Learning of Topic Models on GPUs
  di: Li, Kaiwei, et al.
  Pubblicazione: (2016)