MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning

Documenti analoghi

• MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning
  di: Zhang, Jingfan, et al.
  Pubblicazione: (2024)
• LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks
  di: Wang, Hanqing, et al.
  Pubblicazione: (2024)
• Robust LLM Unlearning Against Relearning Attacks: The Minor Components in Representations Matter
  di: Xiao, Zeguan, et al.
  Pubblicazione: (2026)
• PACIT: Unlocking the Power of Examples for Better In-Context Instruction Tuning
  di: Xue, Tianci, et al.
  Pubblicazione: (2023)
• SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation
  di: Li, Yixia, et al.
  Pubblicazione: (2024)