UniPool: A Globally Shared Expert Pool for Mixture-of-Experts

Documents similaires

• V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving
  par: Luo, Xuewen, et autres
  Publié: (2025)
• ASDFormer: A Transformer with Mixtures of Pooling-Classifier Experts for Robust Autism Diagnosis and Biomarker Discovery
  par: Izadi, Mohammad, et autres
  Publié: (2025)
• Dynamic Adaptive Shared Experts with Grouped Multi-Head Attention Mixture of Experts
  par: Li, Cheng, et autres
  Publié: (2025)
• Klotski: Efficient Mixture-of-Expert Inference via Expert-Aware Multi-Batch Pipeline
  par: Fang, Zhiyuan, et autres
  Publié: (2025)
• MoE-I$^2$: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition
  par: Yang, Cheng, et autres
  Publié: (2024)