Improving the Downstream Performance of Mixture-of-Experts Transformers via Weak Vanilla Transformers

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lu, Xin, Zhao, Yanyan, Qin, Bing, Liu, Ting
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!