Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs

Documenti analoghi

• MoSLD: An Extremely Parameter-Efficient Mixture-of-Shared LoRAs for Multi-Task Learning
  di: Zhao, Lulu, et al.
  Pubblicazione: (2024)
• Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clustering
  di: Zhao, Ziyu, et al.
  Pubblicazione: (2024)
• KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
  di: Azimi, Rambod, et al.
  Pubblicazione: (2024)
• AirLLM: Diffusion Policy-based Adaptive LoRA for Remote Fine-Tuning of LLM over the Air
  di: Yang, Shiyi, et al.
  Pubblicazione: (2025)
• Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models
  di: Feng, Wenfeng, et al.
  Pubblicazione: (2024)