DiEP: Adaptive Mixture-of-Experts Compression through Differentiable Expert Pruning

Documenti analoghi

• Cluster-Driven Expert Pruning for Mixture-of-Experts Large Language Models
  di: Guo, Hongcheng, et al.
  Pubblicazione: (2025)
• Dropping Experts, Recombining Neurons: Retraining-Free Pruning for Sparse Mixture-of-Experts LLMs
  di: Zhou, Yixiao, et al.
  Pubblicazione: (2025)
• Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Experts
  di: Zhang, Zeliang, et al.
  Pubblicazione: (2024)
• Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
  di: Lu, Xudong, et al.
  Pubblicazione: (2024)
• Mixture of Lookup Experts
  di: Jie, Shibo, et al.
  Pubblicazione: (2025)