Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clustering

Documenti analoghi

• Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
  di: Zhao, Ziyu, et al.
  Pubblicazione: (2025)
• LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
  di: Prabhakar, Akshara, et al.
  Pubblicazione: (2024)
• ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs
  di: Shah, Viraj, et al.
  Pubblicazione: (2023)
• Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing
  di: Cheng, Ming, et al.
  Pubblicazione: (2025)
• K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAs
  di: Ouyang, Ziheng, et al.
  Pubblicazione: (2025)