$\texttt{MoE-RBench}$: Towards Building Reliable Language Models with Sparse Mixture-of-Experts

Documenti analoghi

• SEER-MoE: Sparse Expert Efficiency through Regularization for Mixture-of-Experts
  di: Muzio, Alexandre, et al.
  Pubblicazione: (2024)
• Leave It to the Experts: Detecting Knowledge Distillation via MoE Expert Signatures
  di: Li, Pingzhi, et al.
  Pubblicazione: (2025)
• $\infty$-MoE: Generalizing Mixture of Experts to Infinite Experts
  di: Takashiro, Shota, et al.
  Pubblicazione: (2026)
• QuantMoE-Bench: Examining Post-Training Quantization for Mixture-of-Experts
  di: Li, Pingzhi, et al.
  Pubblicazione: (2024)
• FLAME-MoE: A Transparent End-to-End Research Platform for Mixture-of-Experts Language Models
  di: Kang, Hao, et al.
  Pubblicazione: (2025)