GreenLLM: Disaggregating Large Language Model Serving on Heterogeneous GPUs for Lower Carbon Emissions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shi, Tianyao, Wu, Yanran, Liu, Sihang, Ding, Yi
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!