Harder Tasks Need More Experts: Dynamic Routing in MoE Models

Documenti analoghi

• Probing Multimodal Large Language Models for Global and Local Semantic Representations
  di: Tao, Mingxu, et al.
  Pubblicazione: (2024)
• Unlocking the Potential of Model Merging for Low-Resource Languages
  di: Tao, Mingxu, et al.
  Pubblicazione: (2024)
• Can Perplexity Reflect Large Language Model's Ability in Long Text Understanding?
  di: Hu, Yutong, et al.
  Pubblicazione: (2024)
• MC$^2$: Towards Transparent and Culturally-Aware NLP for Minority Languages in China
  di: Zhang, Chen, et al.
  Pubblicazione: (2023)
• Grove MoE: Towards Efficient and Superior MoE LLMs with Adjugate Experts
  di: Wu, Haoyuan, et al.
  Pubblicazione: (2025)