DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts

Documenti analoghi

• Elastic MoE: Unlocking the Inference-Time Scalability of Mixture-of-Experts
  di: Gu, Naibin, et al.
  Pubblicazione: (2025)
• CBP-Tuning: Efficient Local Customization for Black-box Large Language Models
  di: Zhao, Jiaxuan, et al.
  Pubblicazione: (2025)
• Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning
  di: Gu, Naibin, et al.
  Pubblicazione: (2024)
• MoE-LLaVA: Mixture of Experts for Large Vision-Language Models
  di: Lin, Bin, et al.
  Pubblicazione: (2024)
• DAG-MoE: From Simple Mixture to Structural Aggregation in Mixture-of-Experts
  di: Feng, Jiarui, et al.
  Pubblicazione: (2026)