NeuronMoE: Neuron-Guided Mixture-of-Experts for Efficient Multilingual LLM Extension

Documenti analoghi

• Exploring Intra and Inter-language Consistency in Embeddings with ICA
  di: Li, Rongzhi, et al.
  Pubblicazione: (2024)
• On the Multilingual Ability of Decoder-based Pre-trained Language Models: Finding and Controlling Language-Specific Neurons
  di: Kojima, Takeshi, et al.
  Pubblicazione: (2024)
• Neuron-Level Analysis of Cultural Understanding in Large Language Models
  di: Yamamoto, Taisei, et al.
  Pubblicazione: (2025)
• Mixture of Neuron Experts
  di: Cheng, Runxi, et al.
  Pubblicazione: (2025)
• Fine-Grained Analysis of Shared Syntactic Mechanisms in Language Models
  di: Kumon, Ryoma, et al.
  Pubblicazione: (2026)