Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hwang, Ranggi, Wei, Jianyu, Cao, Shijie, Hwang, Changho, Tang, Xiaohu, Cao, Ting, Yang, Mao
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!