FREESH: Fair, Resource- and Energy-Efficient Scheduling for LLM Serving on Heterogeneous GPUs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: He, Xuan, Fang, Zequan, Lian, Jinzhao, Tsang, Danny H. K., Zhang, Baosen, Chen, Yize
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!