SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget

Documenti analoghi

• VEQ: Modality-Adaptive Quantization for MoE Vision-Language Models
  di: Qin, Guangshuo, et al.
  Pubblicazione: (2026)
• LoRA-Switch: Boosting the Efficiency of Dynamic LLM Adapters via System-Algorithm Co-design
  di: Kong, Rui, et al.
  Pubblicazione: (2024)
• MoEless: Efficient MoE LLM Serving via Serverless Computing
  di: Yu, Hanfei, et al.
  Pubblicazione: (2026)
• MoE-Prefill: Zero Redundancy Overheads in MoE Prefill Serving
  di: Su, Zhaoyuan, et al.
  Pubblicazione: (2026)
• BrownoutServe: SLO-Aware Inference Serving under Bursty Workloads for MoE-based LLMs
  di: Hu, Jianmin, et al.
  Pubblicazione: (2025)