BlackMamba: Mixture of Experts for State-Space Models

Documenti analoghi

• Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inference
  di: Yao, Jinghan, et al.
  Pubblicazione: (2024)
• Zyda-2: a 5 Trillion Token High-Quality Dataset
  di: Tokpanov, Yury, et al.
  Pubblicazione: (2024)
• Training Foundation Models on a Full-Stack AMD Platform: Compute, Networking, and System Design
  di: Anthony, Quentin, et al.
  Pubblicazione: (2025)
• Linear-MoE: Linear Sequence Modeling Meets Mixture-of-Experts
  di: Sun, Weigao, et al.
  Pubblicazione: (2025)
• FourierMoE: Fourier Mixture-of-Experts Adaptation of Large Language Models
  di: Jiang, Juyong, et al.
  Pubblicazione: (2026)