MoE-Sieve: Routing-Guided LoRA for Efficient MoE Fine-Tuning

Documenti analoghi

• Adaptive and Fine-grained Module-wise Expert Pruning for Efficient LoRA-MoE Fine-Tuning
  di: Li, Weihang, et al.
  Pubblicazione: (2026)
• A Sensitivity-Driven Expert Allocation Method in LoRA-MoE for Efficient Fine-Tuning
  di: Xu, Junzhou, et al.
  Pubblicazione: (2025)
• TT-LoRA MoE: Unifying Parameter-Efficient Fine-Tuning and Sparse Mixture-of-Experts
  di: Kunwar, Pradip, et al.
  Pubblicazione: (2025)
• Towards Specialized Generalists: A Multi-Task MoE-LoRA Framework for Domain-Specific LLM Adaptation
  di: Yang, Yuxin, et al.
  Pubblicazione: (2026)
• MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning
  di: Yang, Shu, et al.
  Pubblicazione: (2024)