Mixture-of-Experts with Gradient Conflict-Driven Subspace Topology Pruning for Emergent Modularity

Documenti analoghi

• Grassmannian Mixture-of-Experts: Concentration-Controlled Routing on Subspace Manifolds
  di: Shihab, Ibne Farabi, et al.
  Pubblicazione: (2026)
• Mixture of Length and Pruning Experts for Knowledge Graphs Reasoning
  di: Du, Enjun, et al.
  Pubblicazione: (2025)
• Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging
  di: Li, Lujun, et al.
  Pubblicazione: (2025)
• Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Experts
  di: Zhang, Zeliang, et al.
  Pubblicazione: (2024)
• A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts
  di: Chowdhury, Mohammed Nowaz Rabbani, et al.
  Pubblicazione: (2024)