Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ponkshe, Kaustubh, Singhal, Raghav, Gorbunov, Eduard, Tumanov, Alexey, Horvath, Samuel, Vepakomma, Praneeth
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!