Efficient, VRAM-Constrained xLM Inference on Clients

Documenti analoghi

• Splitwiser: Efficient LM inference with constrained resources
  di: Aali, Asad, et al.
  Pubblicazione: (2025)
• SPAD: Specialized Prefill and Decode Hardware for Disaggregated LLM Inference
  di: Zhang, Hengrui, et al.
  Pubblicazione: (2025)
• Performance Modeling and Workload Analysis of Distributed Large Language Model Training and Inference
  di: Kundu, Joyjit, et al.
  Pubblicazione: (2024)
• An End-to-End DNN Inference Framework for the SpiNNaker2 Neuromorphic MPSoC
  di: Jobst, Matthias, et al.
  Pubblicazione: (2025)
• ENEC: A Lossless AI Model Compression Method Enabling Fast Inference on Ascend NPUs
  di: Yang, Jinwu, et al.
  Pubblicazione: (2026)