Relay Buffer Independent Communication over Pooled HBM for Efficient MoE Inference on Ascend

Documenti analoghi

• Remoe: Towards Efficient and Low-Cost MoE Inference in Serverless Computing
  di: Liu, Wentao, et al.
  Pubblicazione: (2025)
• EC2MoE: Adaptive End-Cloud Pipeline Collaboration Enabling Scalable Mixture-of-Experts Inference
  di: Yang, Zheming, et al.
  Pubblicazione: (2025)
• Accelerating Distributed MoE Training and Inference with Lina
  di: Li, Jiamin, et al.
  Pubblicazione: (2022)
• MoE-Compression: How the Compression Error of Experts Affects the Inference Accuracy of MoE Model?
  di: Ma, Songkai, et al.
  Pubblicazione: (2025)
• OD-MoE: On-Demand Expert Loading for Cacheless Edge-Distributed MoE Inference
  di: Wang, Liujianfu, et al.
  Pubblicazione: (2025)