MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhu, Ruidong, Jiang, Ziheng, Jin, Chao, Wu, Peng, Stuardo, Cesar A., Wang, Dongyang, Zhang, Xinlei, Zhou, Huaping, Wei, Haoran, Cheng, Yang, Xiao, Jianzhe, Zhang, Xinyi, Liu, Lingjun, Lin, Haibin, Chang, Li-Wen, Ye, Jianxi, Yu, Xiao, Liu, Xuanzhe, Jin, Xin, Liu, Xin
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2504.02263