Towards Principled Design of Mixture-of-Experts Language Models under Memory and Inference Constraints

Ähnliche Einträge

• Scaling Laws for Upcycling Mixture-of-Experts Language Models
  von: Liew, Seng Pei, et al.
  Veröffentlicht: (2025)
• Reusing Overtrained Language Models Saturates Scaling
  von: Liew, Seng Pei, et al.
  Veröffentlicht: (2025)
• Towards Stable and Effective Reinforcement Learning for Mixture-of-Experts
  von: Zhang, Di, et al.
  Veröffentlicht: (2025)
• Bayesian Mixture of Experts For Large Language Models
  von: Dialameh, Maryam, et al.
  Veröffentlicht: (2025)
• MLP Fusion: Towards Efficient Fine-tuning of Dense and Mixture-of-Experts Language Models
  von: Ai, Mengting, et al.
  Veröffentlicht: (2023)