MoEless: Efficient MoE LLM Serving via Serverless Computing

Documenti analoghi

• Taming Latency-Memory Trade-Off in MoE-Based LLM Serving via Fine-Grained Expert Offloading
  di: Yu, Hanfei, et al.
  Pubblicazione: (2025)
• Remoe: Towards Efficient and Low-Cost MoE Inference in Serverless Computing
  di: Liu, Wentao, et al.
  Pubblicazione: (2025)
• D$^{2}$MoE: Dual Routing and Dynamic Scheduling for Efficient On-Device MoE-based LLM Serving
  di: Wang, Haodong, et al.
  Pubblicazione: (2025)
• ZipMoE: Efficient On-Device MoE Serving via Lossless Compression and Cache-Affinity Scheduling
  di: Yang, Yuchen, et al.
  Pubblicazione: (2026)
• MoE-Lens: Towards the Hardware Limit of High-Throughput MoE LLM Serving Under Resource Constraints
  di: Yuan, Yichao, et al.
  Pubblicazione: (2025)