X-MoE: Enabling Scalable Training for Emerging Mixture-of-Experts Architectures on HPC Platforms

Documenti analoghi

• Piper: Efficient Large-Scale MoE Training via Resource Modeling and Pipelined Hybrid Parallelism
  di: Dash, Sajal, et al.
  Pubblicazione: (2026)
• Hexa-MoE: Efficient and Heterogeneous-aware Training for Mixture-of-Experts
  di: Luo, Shuqing, et al.
  Pubblicazione: (2024)
• EC2MoE: Adaptive End-Cloud Pipeline Collaboration Enabling Scalable Mixture-of-Experts Inference
  di: Yang, Zheming, et al.
  Pubblicazione: (2025)
• Janus: Disaggregating Attention and Experts for Scalable MoE Inference
  di: Zhang, Zhexiang, et al.
  Pubblicazione: (2025)
• Stable-MoE: Lyapunov-based Token Routing for Distributed Mixture-of-Experts Training over Edge Networks
  di: Shi, Long, et al.
  Pubblicazione: (2025)