Innovator: Scientific Continued Pretraining with Fine-grained MoE Upcycling

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liao, Ning, Wang, Xiaoxing, Lin, Zehao, Guo, Weiyang, Hong, Feng, Song, Shixiang, Yu, Geng, Zhao, Zihua, Xie, Sitao, Wei, Longxuan, Jin, Xiangqi, Qin, Xiaohan, Ma, Jiale, Chen, Kai, Yao, Jiangchao, Lin, Zhouhan, Yan, Junchi, Li, Zhiyu, Xiong, Feiyu, Wang, Yanfeng, Zhang, Linfeng
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2507.18671