SLO-aware GPU Frequency Scaling for Energy Efficient LLM Inference Serving

Documenti analoghi

• Leveraging Core and Uncore Frequency Scaling for Power-Efficient Serverless Workflows
  di: Tzenetopoulos, Achilleas, et al.
  Pubblicazione: (2024)
• Multi-Partner Project: Multi-GPU Performance Portability Analysis for CFD Simulations at Scale
  di: Eleftherakis, Panagiotis-Eleftherios, et al.
  Pubblicazione: (2026)
• SynergAI: Edge-to-Cloud Synergy for Architecture-Driven High-Performance Orchestration for AI Inference
  di: Stathopoulou, Foteini, et al.
  Pubblicazione: (2025)
• Understanding Bottlenecks for Efficiently Serving LLM Inference With KV Offloading
  di: Meng, William, et al.
  Pubblicazione: (2025)
• Characterizing CPU-Induced Slowdowns in Multi-GPU LLM Inference
  di: Chung, Euijun, et al.
  Pubblicazione: (2026)