AdaMoLE: Fine-Tuning Large Language Models with Adaptive Mixture of Low-Rank Adaptation Experts

Ähnliche Einträge

• MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
  von: Tang, Chuanyu, et al.
  Veröffentlicht: (2024)
• MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Models
  von: Luo, Tongxu, et al.
  Veröffentlicht: (2024)
• TPP-LLM: Modeling Temporal Point Processes by Efficiently Fine-Tuning Large Language Models
  von: Liu, Zefang, et al.
  Veröffentlicht: (2024)
• RotMoLE: Enhancing Mixture of Low-Rank Experts through Rotational Gating Mechanism
  von: Sun, Mengyang, et al.
  Veröffentlicht: (2026)
• DynMoLE: Boosting Mixture of LoRA Experts Fine-Tuning with a Hybrid Routing Mechanism
  von: Li, Dengchun, et al.
  Veröffentlicht: (2025)