The Rise of Sparse Mixture-of-Experts: A Survey from Algorithmic Foundations to Decentralized Architectures and Vertical Domain Applications

Ähnliche Einträge

• A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications
  von: Mu, Siyuan, et al.
  Veröffentlicht: (2025)
• Modeling Expert Interactions in Sparse Mixture of Experts via Graph Structures
  von: Nguyen-Nhat, Minh-Khoi, et al.
  Veröffentlicht: (2025)
• Exploring Expert Specialization through Unsupervised Training in Sparse Mixture of Experts
  von: Nikolic, Strahinja, et al.
  Veröffentlicht: (2025)
• Dense Backpropagation Improves Training for Sparse Mixture-of-Experts
  von: Panda, Ashwinee, et al.
  Veröffentlicht: (2025)
• SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models
  von: Tang, Anke, et al.
  Veröffentlicht: (2024)