Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference

Documenti analoghi

• DynamoLLM: Designing LLM Inference Clusters for Performance and Energy Efficiency
  di: Stojkovic, Jovan, et al.
  Pubblicazione: (2024)
• Splitwise: Efficient generative LLM inference using phase splitting
  di: Patel, Pratyush, et al.
  Pubblicazione: (2023)
• Rearchitecting Datacenter Lifecycle for AI: A TCO-Driven Framework
  di: Stojkovic, Jovan, et al.
  Pubblicazione: (2025)
• Chameleon: Adaptive Caching and Scheduling for Many-Adapter LLM Inference Environments
  di: Iliakopoulou, Nikoleta, et al.
  Pubblicazione: (2024)
• TAPAS: Thermal- and Power-Aware Scheduling for LLM Inference in Cloud Platforms
  di: Stojkovic, Jovan, et al.
  Pubblicazione: (2025)