OD-MoE: On-Demand Expert Loading for Cacheless Edge-Distributed MoE Inference

Documenti analoghi

• GRACE-MoE: Grouping and Replication with Locality-Aware Routing for Efficient Distributed MoE Inference
  di: Han, Yu, et al.
  Pubblicazione: (2025)
• Accelerating Edge Inference for Distributed MoE Models with Latency-Optimized Expert Placement
  di: Wu, Tian, et al.
  Pubblicazione: (2025)
• EPS-MoE: Expert Pipeline Scheduler for Cost-Efficient MoE Inference
  di: Qian, Yulei, et al.
  Pubblicazione: (2024)
• SP-MoE: Speculative Decoding and Prefetching for Accelerating MoE-based Model Inference
  di: Chen, Liangkun, et al.
  Pubblicazione: (2025)
• Janus: Disaggregating Attention and Experts for Scalable MoE Inference
  di: Zhang, Zhexiang, et al.
  Pubblicazione: (2025)