Buchumschlag

P/D-Serve: Serving Disaggregated Large Language Model at Scale

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Jin, Yibo, Wang, Tao, Lin, Huimin, Song, Mingyang, Li, Peiyang, Ma, Yipeng, Shan, Yicheng, Yuan, Zhengfan, Li, Cailong, Sun, Yajing, Wu, Tiandeng, Chu, Xing, Huan, Ruizhi, Ma, Li, You, Xiao, Zhou, Wenting, Ye, Yunpeng, Liu, Wen, Xu, Xiangkun, Zhang, Yongsheng, Dong, Tiantian, Zhu, Jiawei, Wang, Zhe, Ju, Xijian, Song, Jianxun, Cheng, Haoliang, Li, Xiaojing, Ding, Jiandong, Guo, Hefei, Zhang, Zhengyong
Format:	Preprint
Veröffentlicht:	2024
Schlagworte:	Distributed, Parallel, and Cluster Computing Computation and Language Machine Learning
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Online

https://arxiv.org/abs/2408.08147