Stabilized Fine-Tuning with LoRA in Federated Learning: Mitigating the Side Effect of Client Size and Rank via the Scaling Factor

Documenti analoghi

• MLAE: Masked LoRA Experts for Visual Parameter-Efficient Fine-Tuning
  di: Wang, Junjie, et al.
  Pubblicazione: (2024)
• LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
  di: Bian, Jieming, et al.
  Pubblicazione: (2024)
• DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
  di: Deng, Guanzhi, et al.
  Pubblicazione: (2026)
• Rethinking the Rank Threshold for LoRA Fine-Tuning
  di: Park, Juneyoung
  Pubblicazione: (2026)
• Fed-pilot: Optimizing LoRA Allocation for Efficient Federated Fine-Tuning with Heterogeneous Clients
  di: Zhang, Zikai, et al.
  Pubblicazione: (2024)