Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts

Documenti analoghi

• Is Temperature Sample Efficient for Softmax Gaussian Mixture of Experts?
  di: Nguyen, Huy, et al.
  Pubblicazione: (2024)
• A General Theory for Softmax Gating Multinomial Logistic Mixture of Experts
  di: Nguyen, Huy, et al.
  Pubblicazione: (2023)
• Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective
  di: Yan, Fanqi, et al.
  Pubblicazione: (2025)
• On Minimax Estimation of Parameters in Softmax-Contaminated Mixture of Experts
  di: Yan, Fanqi, et al.
  Pubblicazione: (2025)
• Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention
  di: Akbarian, Pedram, et al.
  Pubblicazione: (2024)