Mosaic: Data-Free Knowledge Distillation via Mixture-of-Experts for Heterogeneous Distributed Environments

Documenti analoghi

• FlowMoE: A Scalable Pipeline Scheduling Framework for Distributed Mixture-of-Experts Training
  di: Gao, Yunqi, et al.
  Pubblicazione: (2025)
• Hexa-MoE: Efficient and Heterogeneous-aware Training for Mixture-of-Experts
  di: Luo, Shuqing, et al.
  Pubblicazione: (2024)
• Elastic Mixture of Rank-Wise Experts for Knowledge Reuse in Federated Fine-Tuning
  di: Wu, Yebo, et al.
  Pubblicazione: (2025)
• Toward Cost-Efficient Serving of Mixture-of-Experts with Asynchrony
  di: Wang, Shaoyu, et al.
  Pubblicazione: (2025)
• HeterMoE: Efficient Training of Mixture-of-Experts Models on Heterogeneous GPUs
  di: Wu, Yongji, et al.
  Pubblicazione: (2025)