Taming LLMs by Scaling Learning Rates with Gradient Grouping

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Siyuan, Tian, Juanxi, Wang, Zedong, Jin, Xin, Liu, Zicheng, Zhang, Wentao, Xu, Dan
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2506.01049