Mosaic Pruning: A Hierarchical Framework for Generalizable Pruning of Mixture-of-Experts Models

Documenti analoghi

• Awakening Dormant Experts:Counterfactual Routing to Mitigate MoE Hallucinations
  di: Hu, Wentao, et al.
  Pubblicazione: (2026)
• Pruning and Distilling Mixture-of-Experts into Dense Language Models
  di: Kim, Junhyuck, et al.
  Pubblicazione: (2026)
• Mosaic: Composite Projection Pruning for Resource-efficient LLMs
  di: Eccles, Bailey J., et al.
  Pubblicazione: (2025)
• Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
  di: Lu, Xudong, et al.
  Pubblicazione: (2024)
• MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Router
  di: Xie, Yanyue, et al.
  Pubblicazione: (2024)