PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning

Documenti analoghi

• Advancing Graph Representation Learning with Large Language Models: A Comprehensive Survey of Techniques
  di: Mao, Qiheng, et al.
  Pubblicazione: (2024)
• MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Models
  di: Liu, Zehua, et al.
  Pubblicazione: (2025)
• MoMQ: Mixture-of-Experts Enhances Multi-Dialect Query Generation across Relational and Non-Relational Databases
  di: Lin, Zhisheng, et al.
  Pubblicazione: (2024)
• Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules
  di: Liu, Yilun, et al.
  Pubblicazione: (2025)
• Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Experts
  di: Zhang, Zeliang, et al.
  Pubblicazione: (2024)