Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference

Documenti analoghi

• PASCAL: A Phase-Aware Scheduling Algorithm for Serving Reasoning-based Large Language Models
  di: Cho, Eunyeong, et al.
  Pubblicazione: (2026)
• T-MAN: Enabling End-to-End Low-Bit LLM Inference on NPUs via Unified Table Lookup
  di: Wei, Jianyu, et al.
  Pubblicazione: (2025)
• SliceMoE: Bit-Sliced Expert Caching under Miss-Rate Constraints for Efficient MoE Inference
  di: Choi, Yuseon, et al.
  Pubblicazione: (2025)
• A3D-MoE: Acceleration of Large Language Models with Mixture of Experts via 3D Heterogeneous Integration
  di: Huang, Wei-Hsing, et al.
  Pubblicazione: (2025)
• Expert Streaming: Accelerating Low-Batch MoE Inference via Multi-chiplet Architecture and Dynamic Expert Trajectory Scheduling
  di: Ma, Songchen, et al.
  Pubblicazione: (2026)