Lynx: Enabling Efficient MoE Inference through Dynamic Batch-Aware Expert Selection

Documenti analoghi

• eMoE: Task-aware Memory Efficient Mixture-of-Experts-Based (MoE) Model Inference
  di: Tairin, Suraiya, et al.
  Pubblicazione: (2025)
• OD-MoE: On-Demand Expert Loading for Cacheless Edge-Distributed MoE Inference
  di: Wang, Liujianfu, et al.
  Pubblicazione: (2025)
• Janus: Disaggregating Attention and Experts for Scalable MoE Inference
  di: Zhang, Zhexiang, et al.
  Pubblicazione: (2025)
• GRACE-MoE: Grouping and Replication with Locality-Aware Routing for Efficient Distributed MoE Inference
  di: Han, Yu, et al.
  Pubblicazione: (2025)
• EC2MoE: Adaptive End-Cloud Pipeline Collaboration Enabling Scalable Mixture-of-Experts Inference
  di: Yang, Zheming, et al.
  Pubblicazione: (2025)