Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient Upcycling

Documenti analoghi

• Marco-o1: Towards Open Reasoning Models for Open-Ended Solutions
  di: Zhao, Yu, et al.
  Pubblicazione: (2024)
• Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts
  di: Li, Yunxin, et al.
  Pubblicazione: (2024)
• MoE-LPR: Multilingual Extension of Large Language Models through Mixture-of-Experts with Language Priors Routing
  di: Zhou, Hao, et al.
  Pubblicazione: (2024)
• CLIP-MoE: Towards Building Mixture of Experts for CLIP with Diversified Multiplet Upcycling
  di: Zhang, Jihai, et al.
  Pubblicazione: (2024)
• MoE-Loco: Mixture of Experts for Multitask Locomotion
  di: Huang, Runhan, et al.
  Pubblicazione: (2025)