DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models

Documenti analoghi

• MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts
  di: Jin, Peng, et al.
  Pubblicazione: (2024)
• Horseshoe Mixtures-of-Experts (HS-MoE)
  di: Polson, Nick, et al.
  Pubblicazione: (2026)
• $\infty$-MoE: Generalizing Mixture of Experts to Infinite Experts
  di: Takashiro, Shota, et al.
  Pubblicazione: (2026)
• Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inference
  di: Liu, Baihui, et al.
  Pubblicazione: (2026)
• MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
  di: Chen, Xiaodong, et al.
  Pubblicazione: (2025)