D$^{2}$MoE: Dual Routing and Dynamic Scheduling for Efficient On-Device MoE-based LLM Serving

Documenti analoghi

• ProMoE: Fast MoE-based LLM Serving using Proactive Caching
  di: Song, Xiaoniu, et al.
  Pubblicazione: (2024)
• ZipMoE: Efficient On-Device MoE Serving via Lossless Compression and Cache-Affinity Scheduling
  di: Yang, Yuchen, et al.
  Pubblicazione: (2026)
• MoE-Lens: Towards the Hardware Limit of High-Throughput MoE LLM Serving Under Resource Constraints
  di: Yuan, Yichao, et al.
  Pubblicazione: (2025)
• MoEless: Efficient MoE LLM Serving via Serverless Computing
  di: Yu, Hanfei, et al.
  Pubblicazione: (2026)
• Efficient MoE Inference with Fine-Grained Scheduling of Disaggregated Expert Parallelism
  di: Pan, Xinglin, et al.
  Pubblicazione: (2025)