Learning in the Fisher Subspace: A Guided Initialization for LoRA Fine-Tuning

Documenti analoghi

• LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
  di: Bian, Jieming, et al.
  Pubblicazione: (2024)
• SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
  di: Luo, Minrui, et al.
  Pubblicazione: (2025)
• CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
  di: Chen, Guanduo, et al.
  Pubblicazione: (2025)
• Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics
  di: Li, Shiwei, et al.
  Pubblicazione: (2025)
• KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
  di: Azimi, Rambod, et al.
  Pubblicazione: (2024)