Accelerating Distributed MoE Training and Inference with Lina

Documenti analoghi

• Accelerating Edge Inference for Distributed MoE Models with Latency-Optimized Expert Placement
  di: Wu, Tian, et al.
  Pubblicazione: (2025)
• SP-MoE: Speculative Decoding and Prefetching for Accelerating MoE-based Model Inference
  di: Chen, Liangkun, et al.
  Pubblicazione: (2025)
• GRACE-MoE: Grouping and Replication with Locality-Aware Routing for Efficient Distributed MoE Inference
  di: Han, Yu, et al.
  Pubblicazione: (2025)
• OD-MoE: On-Demand Expert Loading for Cacheless Edge-Distributed MoE Inference
  di: Wang, Liujianfu, et al.
  Pubblicazione: (2025)
• LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing
  di: Nie, Xiaonan, et al.
  Pubblicazione: (2024)