Train Separately, Merge Together: Modular Post-Training with Mixture-of-Experts

Documenti analoghi

• EMO: Pretraining Mixture of Experts for Emergent Modularity
  di: Wang, Ryan, et al.
  Pubblicazione: (2026)
• OLMoE: Open Mixture-of-Experts Language Models
  di: Muennighoff, Niklas, et al.
  Pubblicazione: (2024)
• Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
  di: Morrison, Jacob, et al.
  Pubblicazione: (2024)
• Local Mixtures of Experts: Essentially Free Test-Time Training via Model Merging
  di: Bertolissi, Ryo, et al.
  Pubblicazione: (2025)
• Learning More Generalized Experts by Merging Experts in Mixture-of-Experts
  di: Park, Sejik
  Pubblicazione: (2024)