MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Yupeng, Wang, Senmiao, Zhang, Yushun, Lin, Zhihang, Zhang, Haozhe, Sun, Weijian, Ding, Tian, Sun, Ruoyu
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2407.20999