AdaPreLoRA: Adafactor Preconditioned Low-Rank Adaptation

Documenti analoghi

• MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
  di: Yang, Yaming, et al.
  Pubblicazione: (2024)
• LoRA+: Efficient Low Rank Adaptation of Large Models
  di: Hayou, Soufiane, et al.
  Pubblicazione: (2024)
• SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information
  di: Zhou, Kaiye, et al.
  Pubblicazione: (2024)
• LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
  di: Bałazy, Klaudia, et al.
  Pubblicazione: (2024)
• LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
  di: Wang, Zhengbo, et al.
  Pubblicazione: (2024)