TP-Aware Dequantization

Documenti analoghi

• Accelerating a Triton Fused Kernel for W4A16 Quantized Inference with SplitK work decomposition
  di: Hoque, Adnan, et al.
  Pubblicazione: (2024)
• HadaCore: Tensor Core Accelerated Hadamard Transform Kernel
  di: Agarwal, Krish, et al.
  Pubblicazione: (2024)
• Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization
  di: Li, Jinhao, et al.
  Pubblicazione: (2023)
• Preble: Efficient Distributed Prompt Scheduling for LLM Serving
  di: Srivatsa, Vikranth, et al.
  Pubblicazione: (2024)
• Scalable High-Dimensional Multivariate Linear Regression for Feature-Distributed Data
  di: Huang, Shuo-Chieh, et al.
  Pubblicazione: (2023)