How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Luo, Kairong, Sun, Zhenbo, Wen, Haodong, Shi, Xinyu, Cui, Jiarui, Dang, Chenyi, Lyu, Kaifeng, Chen, Wenguang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!