CoX-MoE: Coalesced Expert Execution for High-Throughput MoE Inference with AMX-Enabled CPU-GPU Co-Execution

Documenti analoghi

• TriMoE: Augmenting GPU with AMX-Enabled CPU and DIMM-NDP for High-Throughput MoE Inference via Offloading
  di: Pan, Yudong, et al.
  Pubblicazione: (2026)
• MoE-Gen: High-Throughput MoE Inference on a Single GPU with Module-Based Batching
  di: Xu, Tairan, et al.
  Pubblicazione: (2025)
• MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs
  di: Cao, Shiyi, et al.
  Pubblicazione: (2024)
• HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference
  di: Zhong, Shuzhang, et al.
  Pubblicazione: (2025)
• Efficient CPU-GPU Collaborative Inference for MoE-based LLMs on Memory-Limited Systems
  di: Huang, En-Ming, et al.
  Pubblicazione: (2025)