OMoE: Diversifying Mixture of Low-Rank Adaptation by Orthogonal Finetuning

Documenti analoghi

• CoMoE: Contrastive Representation for Mixture-of-Experts in Parameter-Efficient Fine-tuning
  di: Feng, Jinyuan, et al.
  Pubblicazione: (2025)
• Efficient Soft Actor-Critic with LLM-Based Action-Level Guidance for Continuous Control
  di: Ma, Hao, et al.
  Pubblicazione: (2026)
• MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
  di: Tang, Chuanyu, et al.
  Pubblicazione: (2024)
• Orthogonal Finetuning for Direct Preference Optimization
  di: Yang, Chenxu, et al.
  Pubblicazione: (2024)
• MALoRA: Mixture of Asymmetric Low-Rank Adaptation for Enhanced Multi-Task Learning
  di: Wang, Xujia, et al.
  Pubblicazione: (2024)