ConServe: Fine-Grained GPU Harvesting for LLM Online and Offline Co-Serving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Qiao, Yifan, Anzai, Shu, Yu, Shan, Ma, Haoran, Yang, Shuo, Wang, Yang, Kim, Miryung, Wu, Yongji, Zhou, Yang, Xing, Jiarong, Gonzalez, Joseph E., Stoica, Ion, Xu, Harry
Format:	Preprint
Published:	2024
Subjects:	Distributed, Parallel, and Cluster Computing Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2410.01228