MaskMoE: Boosting Token-Level Learning via Routing Mask in Mixture-of-Experts

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Su, Zhenpeng, Lin, Zijia, Bai, Xue, Wu, Xing, Xiong, Yizhe, Lian, Haoran, Ma, Guangyuan, Chen, Hui, Ding, Guiguang, Zhou, Wei, Hu, Songlin
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!