FlyLoRA: Boosting Task Decoupling and Parameter Efficiency via Implicit Rank-Wise Mixture-of-Experts

Documenti analoghi

• Fly-CL: A Fly-Inspired Framework for Enhancing Efficient Decorrelation and Reduced Training Time in Pre-trained Model-based Continual Representation Learning
  di: Zou, Heming, et al.
  Pubblicazione: (2025)
• Structural features of the fly olfactory circuit mitigate the stability-plasticity dilemma in continual learning
  di: Zou, Heming, et al.
  Pubblicazione: (2025)
• Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
  di: Zhao, Ziyu, et al.
  Pubblicazione: (2025)
• AT-MoE: Adaptive Task-planning Mixture of Experts via LoRA Approach
  di: Li, Xurui, et al.
  Pubblicazione: (2024)
• DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
  di: Deng, Guanzhi, et al.
  Pubblicazione: (2026)