Retraining-Free Merging of Sparse MoE via Hierarchical Clustering

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, I-Chun, Liu, Hsu-Shen, Sun, Wei-Fang, Chao, Chen-Hao, Hsu, Yen-Chang, Lee, Chun-Yi
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2410.08589