SORSA: Singular Values and Orthonormal Regularized Singular Vectors Adaptation of Large Language Models

Documenti analoghi

• KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models
  di: Wang, Fan, et al.
  Pubblicazione: (2024)
• SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression
  di: Wang, Xin, et al.
  Pubblicazione: (2024)
• PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models
  di: Meng, Fanxu, et al.
  Pubblicazione: (2024)
• SVFit: Parameter-Efficient Fine-Tuning of Large Pre-Trained Models Using Singular Values
  di: Sun, Chengwei, et al.
  Pubblicazione: (2024)
• SARA: Singular-Value Based Adaptive Low-Rank Adaption
  di: Gu, Jihao, et al.
  Pubblicazione: (2024)