Towards Specialized Generalists: A Multi-Task MoE-LoRA Framework for Domain-Specific LLM Adaptation

Documenti analoghi

• Disentangling Task Conflicts in Multi-Task LoRA via Orthogonal Gradient Projection
  di: Yang, Ziyu, et al.
  Pubblicazione: (2026)
• MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning
  di: Yang, Shu, et al.
  Pubblicazione: (2024)
• MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
  di: Yang, Yaming, et al.
  Pubblicazione: (2024)
• MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning
  di: Ma, Yufei, et al.
  Pubblicazione: (2024)
• Dynamic Expert Specialization: Towards Catastrophic Forgetting-Free Multi-Domain MoE Adaptation
  di: Li, Junzhuo, et al.
  Pubblicazione: (2025)