Optimizing Mixture-of-Experts Inference Time Combining Model Deployment and Communication Scheduling

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Jialong, Tripathi, Shreyansh, Rastogi, Lakshay, Lei, Yiming, Pan, Rui, Xia, Yiting
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!