Effective Interplay between Sparsity and Quantization: From Theory to Practice

Documenti analoghi

• Accuracy Booster: Enabling 4-bit Fixed-point Arithmetic for DNN Training
  di: Harma, Simla Burcu, et al.
  Pubblicazione: (2022)
• Progressive Gradient Flow for Robust N:M Sparsity Training in Transformers
  di: Bambhaniya, Abhimanyu Rajeshkumar, et al.
  Pubblicazione: (2024)
• RAGO: Systematic Performance Optimization for Retrieval-Augmented Generation Serving
  di: Jiang, Wenqi, et al.
  Pubblicazione: (2025)
• SLiM: One-shot Quantization and Sparsity with Low-rank Approximation for LLM Weight Compression
  di: Mozaffari, Mohammad, et al.
  Pubblicazione: (2024)
• Uncertainty Estimation of Transformers' Predictions via Topological Analysis of the Attention Matrices
  di: Kostenok, Elizaveta, et al.
  Pubblicazione: (2023)