Understanding Multilingualism in Mixture-of-Experts LLMs: Routing Mechanism, Expert Specialization, and Layerwise Steering

Documenti analoghi

• Layerwise Recurrent Router for Mixture-of-Experts
  di: Qiu, Zihan, et al.
  Pubblicazione: (2024)
• Multilingual Routing in Mixture-of-Experts
  di: Bandarkar, Lucas, et al.
  Pubblicazione: (2025)
• Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs
  di: Bai, Jun, et al.
  Pubblicazione: (2025)
• Do LLMs and VLMs Share Neurons for Inference? Evidence and Mechanisms of Cross-Modal Transfer
  di: Cui, Chenhang, et al.
  Pubblicazione: (2026)
• ExpertSteer: Intervening in LLMs through Expert Knowledge
  di: Wang, Weixuan, et al.
  Pubblicazione: (2025)