Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs

Documenti analoghi

• Understanding Multilingualism in Mixture-of-Experts LLMs: Routing Mechanism, Expert Specialization, and Layerwise Steering
  di: Chen, Yuxin, et al.
  Pubblicazione: (2026)
• Mixture of In-Context Experts Enhance LLMs' Long Context Awareness
  di: Lin, Hongzhan, et al.
  Pubblicazione: (2024)
• Router Upcycling: Leveraging Mixture-of-Routers in Mixture-of-Experts Upcycling
  di: Ran, Junfeng, et al.
  Pubblicazione: (2025)
• SEUF: Is Unlearning One Expert Enough for Mixture-of-Experts LLMs?
  di: Zhuang, Haomin, et al.
  Pubblicazione: (2024)
• ExpertSteer: Intervening in LLMs through Expert Knowledge
  di: Wang, Weixuan, et al.
  Pubblicazione: (2025)