APT-LLM: Exploiting Arbitrary-Precision Tensor Core Computing for LLM Acceleration

Documenti analoghi

• Efficient Arbitrary Precision Acceleration for Large Language Models on GPU Tensor Cores
  di: Ma, Shaobo, et al.
  Pubblicazione: (2024)
• AccLLM: Accelerating Long-Context LLM Inference Via Algorithm-Hardware Co-Design
  di: Liang, Yanbiao, et al.
  Pubblicazione: (2025)
• FastMamba: A High-Speed and Efficient Mamba Accelerator on FPGA with Accurate Quantization
  di: Wang, Aotao, et al.
  Pubblicazione: (2025)
• An FPGA-Based Reconfigurable Accelerator for Convolution-Transformer Hybrid EfficientViT
  di: Shao, Haikuo, et al.
  Pubblicazione: (2024)
• Anda: Unlocking Efficient LLM Inference with a Variable-Length Grouped Activation Data Format
  di: Fang, Chao, et al.
  Pubblicazione: (2024)