Saved in:
Bibliographic Details
Main Authors: Liu, Zihang, Hu, Yuanzhe, Pang, Tianyu, Zhou, Yefan, Ren, Pu, Yang, Yaoqing
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.12178
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914974241128448
author Liu, Zihang
Hu, Yuanzhe
Pang, Tianyu
Zhou, Yefan
Ren, Pu
Yang, Yaoqing
author_facet Liu, Zihang
Hu, Yuanzhe
Pang, Tianyu
Zhou, Yefan
Ren, Pu
Yang, Yaoqing
contents Recent advances in foundation models have emphasized the need to align pre-trained models with specialized domains using small, curated datasets. Studies on these foundation models underscore the importance of low-data training and fine-tuning. This topic, well-known in natural language processing (NLP), has also gained increasing attention in the emerging field of scientific machine learning (SciML). To address the limitations of low-data training and fine-tuning, we draw inspiration from Heavy-Tailed Self-Regularization (HT-SR) theory, analyzing the shape of empirical spectral densities (ESDs) and revealing an imbalance in training quality across different model layers. To mitigate this issue, we adapt a recently proposed layer-wise learning rate scheduler, TempBalance, which effectively balances training quality across layers and enhances low-data training and fine-tuning for both NLP and SciML tasks. Notably, TempBalance demonstrates increasing performance gains as the amount of available tuning data decreases. Comparative analyses further highlight the effectiveness of TempBalance and its adaptability as an "add-on" method for improving model performance.
format Preprint
id arxiv_https___arxiv_org_abs_2410_12178
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Model Balancing Helps Low-data Training and Fine-tuning
Liu, Zihang
Hu, Yuanzhe
Pang, Tianyu
Zhou, Yefan
Ren, Pu
Yang, Yaoqing
Machine Learning
Recent advances in foundation models have emphasized the need to align pre-trained models with specialized domains using small, curated datasets. Studies on these foundation models underscore the importance of low-data training and fine-tuning. This topic, well-known in natural language processing (NLP), has also gained increasing attention in the emerging field of scientific machine learning (SciML). To address the limitations of low-data training and fine-tuning, we draw inspiration from Heavy-Tailed Self-Regularization (HT-SR) theory, analyzing the shape of empirical spectral densities (ESDs) and revealing an imbalance in training quality across different model layers. To mitigate this issue, we adapt a recently proposed layer-wise learning rate scheduler, TempBalance, which effectively balances training quality across layers and enhances low-data training and fine-tuning for both NLP and SciML tasks. Notably, TempBalance demonstrates increasing performance gains as the amount of available tuning data decreases. Comparative analyses further highlight the effectiveness of TempBalance and its adaptability as an "add-on" method for improving model performance.
title Model Balancing Helps Low-data Training and Fine-tuning
topic Machine Learning
url https://arxiv.org/abs/2410.12178