Hexa-MoE: Efficient and Heterogeneous-aware Training for Mixture-of-Experts

Documenti analoghi

• Occult: Optimizing Collaborative Communication across Experts for Accelerated Parallel MoE Training and Inference
  di: Luo, Shuqing, et al.
  Pubblicazione: (2025)
• Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert Parallelism Design
  di: Zhang, Mohan, et al.
  Pubblicazione: (2025)
• LAER-MoE: Load-Adaptive Expert Re-layout for Efficient Mixture-of-Experts Training
  di: Liu, Xinyi, et al.
  Pubblicazione: (2026)
• Stable-MoE: Lyapunov-based Token Routing for Distributed Mixture-of-Experts Training over Edge Networks
  di: Shi, Long, et al.
  Pubblicazione: (2025)
• eMoE: Task-aware Memory Efficient Mixture-of-Experts-Based (MoE) Model Inference
  di: Tairin, Suraiya, et al.
  Pubblicazione: (2025)