RQ-MoE: Residual Quantization via Mixture of Experts for Efficient Input-Dependent Vector Compression

Documenti analoghi

• MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
  di: Chen, Xiaodong, et al.
  Pubblicazione: (2025)
• Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging
  di: Li, Lujun, et al.
  Pubblicazione: (2025)
• Grove MoE: Towards Efficient and Superior MoE LLMs with Adjugate Experts
  di: Wu, Haoyuan, et al.
  Pubblicazione: (2025)
• Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsity
  di: Tang, Yehui, et al.
  Pubblicazione: (2025)
• Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts
  di: Li, Yunxin, et al.
  Pubblicazione: (2024)