Rethinking Gating Mechanism in Sparse MoE: Handling Arbitrary Modality Inputs with Confidence-Guided Gate

Documenti analoghi

• Understanding Why Large Language Models Can Be Ineffective in Time Series Analysis: The Impact of Modality Alignment
  di: Zheng, Liangwei Nathan, et al.
  Pubblicazione: (2024)
• Lifting Manifolds to Mitigate Pseudo-Alignment in LLM4TS
  di: Zheng, Liangwei Nathan, et al.
  Pubblicazione: (2025)
• Probing Routing-Conditional Calibration in Attention-Residual Transformers
  di: Liang, Wenhao, et al.
  Pubblicazione: (2026)
• LLaDA-MoE: A Sparse MoE Diffusion Language Model
  di: Zhu, Fengqi, et al.
  Pubblicazione: (2025)
• Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts
  di: Yun, Sukwon, et al.
  Pubblicazione: (2024)