MoE-Compression: How the Compression Error of Experts Affects the Inference Accuracy of MoE Model?

Documenti analoghi

• OD-MoE: On-Demand Expert Loading for Cacheless Edge-Distributed MoE Inference
  di: Wang, Liujianfu, et al.
  Pubblicazione: (2025)
• EPS-MoE: Expert Pipeline Scheduler for Cost-Efficient MoE Inference
  di: Qian, Yulei, et al.
  Pubblicazione: (2024)
• SP-MoE: Speculative Decoding and Prefetching for Accelerating MoE-based Model Inference
  di: Chen, Liangkun, et al.
  Pubblicazione: (2025)
• Janus: Disaggregating Attention and Experts for Scalable MoE Inference
  di: Zhang, Zhexiang, et al.
  Pubblicazione: (2025)
• GRACE-MoE: Grouping and Replication with Locality-Aware Routing for Efficient Distributed MoE Inference
  di: Han, Yu, et al.
  Pubblicazione: (2025)