Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficient

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ludziejewski, Jan, Pióro, Maciej, Krajewski, Jakub, Stefaniak, Maciej, Krutul, Michał, Małaśnicki, Jan, Cygan, Marek, Sankowski, Piotr, Adamczewski, Kamil, Miłoś, Piotr, Jaszczur, Sebastian
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2502.05172