The Sharpness Disparity Principle in Transformers for Accelerating Language Model Pre-Training

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Jinbo, Wang, Mingze, Zhou, Zhanpeng, Yan, Junchi, E, Weinan, Wu, Lei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!