A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications

Documenti analoghi

• Theory on Mixture-of-Experts in Continual Learning
  di: Li, Hongbo, et al.
  Pubblicazione: (2024)
• The Rise of Sparse Mixture-of-Experts: A Survey from Algorithmic Foundations to Decentralized Architectures and Vertical Domain Applications
  di: Pan, Dong, et al.
  Pubblicazione: (2026)
• Not All Models Suit Expert Offloading: On Local Routing Consistency of Mixture-of-Expert Models
  di: Liang, Jingcong, et al.
  Pubblicazione: (2025)
• Revisiting Incremental Stochastic Majorization-Minimization Algorithms with Applications to Mixture of Experts
  di: Tran, TrungKhang, et al.
  Pubblicazione: (2026)
• Towards a Comprehensive Scaling Law of Mixture-of-Experts
  di: Zhao, Guoliang, et al.
  Pubblicazione: (2025)