MoE-CAP: Benchmarking Cost, Accuracy and Performance of Sparse Mixture-of-Experts Systems

Documenti analoghi

• MoE-CAP: Benchmarking Cost, Accuracy and Performance of Sparse Mixture-of-Experts Systems
  di: Jiang, Yinsicheng, et al.
  Pubblicazione: (2024)
• MoE-Gen: High-Throughput MoE Inference on a Single GPU with Module-Based Batching
  di: Xu, Tairan, et al.
  Pubblicazione: (2025)
• MoE-Infinity: Efficient MoE Inference on Personal Machines with Sparsity-Aware Expert Cache
  di: Xue, Leyang, et al.
  Pubblicazione: (2024)
• WaferLLM: Large Language Model Inference at Wafer Scale
  di: He, Congjie, et al.
  Pubblicazione: (2025)
• SEER-MoE: Sparse Expert Efficiency through Regularization for Mixture-of-Experts
  di: Muzio, Alexandre, et al.
  Pubblicazione: (2024)