WarmServe: Enabling One-for-Many GPU Prewarming for Multi-LLM Serving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lou, Chiheng, Qi, Sheng, Kang, Rui, Zhang, Yong, Sun, Chen, Wang, Pengcheng, Liu, Xuanzhe, Jin, Xin
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2512.09472