SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kong, Rui, Li, Yuanchun, Feng, Qingtian, Wang, Weijun, Ye, Xiaozhou, Ouyang, Ye, Kong, Linghe, Liu, Yunxin
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!