Profiling Large Language Model Inference on Apple Silicon: A Quantization Perspective

Documenti analoghi

• Efficient Mixture-of-Experts LLM Inference with Apple Silicon NPUs
  di: Benazir, Afsara, et al.
  Pubblicazione: (2026)
• Profiling Apple Silicon Performance for ML Training
  di: Feng, Dahua, et al.
  Pubblicazione: (2025)
• Safeguarding Privacy in Edge Speech Understanding with Tiny Foundation Models
  di: Benazir, Afsara, et al.
  Pubblicazione: (2025)
• Speech Understanding on Tiny Devices with A Learning Cache
  di: Benazir, Afsara, et al.
  Pubblicazione: (2023)
• Accelerating Sparse Ternary GEMM for Quantized ML on Apple Silicon
  di: Lipshitz, Baraq, et al.
  Pubblicazione: (2025)