XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection

Documenti analoghi

• UMoE: Unifying Attention and FFN with Shared Experts
  di: Yang, Yuanhang, et al.
  Pubblicazione: (2025)
• FLoE: Fisher-Based Layer Selection for Efficient Sparse Adaptation of Low-Rank Experts
  di: Wang, Xinyi, et al.
  Pubblicazione: (2025)
• Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models
  di: Wang, Zihan, et al.
  Pubblicazione: (2024)
• ReXMoE: Reusing Experts with Minimal Overhead in Mixture-of-Experts
  di: Tan, Zheyue, et al.
  Pubblicazione: (2025)
• Enhancing Multivariate Time Series Forecasting with Mutual Information-driven Cross-Variable and Temporal Modeling
  di: Qi, Shiyi, et al.
  Pubblicazione: (2024)