The 1/W Law: An Analytical Study of Context-Length Routing Topology and GPU Generation Gains for LLM Inference Energy Efficiency

Documenti analoghi

• FleetOpt: Analytical Fleet Provisioning for LLM Inference with Compress-and-Route as Implementation Mechanism
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• Token-Budget-Aware Pool Routing for Cost-Efficient LLM Inference
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• inference-fleet-sim: A Queueing-Theory-Grounded Fleet Capacity Planner for LLM Inference
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• The Workload-Router-Pool Architecture for LLM Inference Optimization: A Vision Paper from the vLLM Semantic Router Project
  di: Chen, Huamin, et al.
  Pubblicazione: (2026)
• DAK: Direct-Access-Enabled GPU Memory Offloading with Optimal Efficiency for LLM Inference
  di: Lin, Shouxu, et al.
  Pubblicazione: (2026)