Fine-Grained Energy Prediction For Parallellized LLM Inference With PIE-P

Documenti analoghi

• Scaling State-Space Models on Multiple GPUs with Tensor Parallelism
  di: Dutt, Anurag, et al.
  Pubblicazione: (2026)
• Can Large Language Models Predict Parallel Code Performance?
  di: Bolet, Gregory, et al.
  Pubblicazione: (2025)
• HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices
  di: Zhao, Xuanlei, et al.
  Pubblicazione: (2024)
• RAPID-LLM: Resilience-Aware Performance analysis of Infrastructure for Distributed LLM Training and Inference
  di: Karfakis, George, et al.
  Pubblicazione: (2025)
• LMDeploy Accelerates Mixed-Precision LLM Inference with TurboMind
  di: Zhang, Li, et al.
  Pubblicazione: (2025)