Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2509.13624 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912695076257792 |
|---|---|
| author | Krishna, Shambhavi Naik, Atharva Agarwal, Chaitali Govindan, Sudharshan Lee, Taesung Chang, Haw-Shiuan |
| author_facet | Krishna, Shambhavi Naik, Atharva Agarwal, Chaitali Govindan, Sudharshan Lee, Taesung Chang, Haw-Shiuan |
| contents | Large language models are increasingly deployed across diverse applications. This often includes tasks LLMs have not encountered during training. This implies that enumerating and obtaining the high-quality training data for all tasks is infeasible. Thus, we often need to rely on transfer learning using datasets with different characteristics, and anticipate out-of-distribution requests. Motivated by this practical need, we propose an analysis framework, building a transfer learning matrix and dimensionality reduction, to dissect these cross-task interactions. We train and analyze 10 models to identify latent abilities (e.g., Reasoning, Sentiment Classification, NLU, Arithmetic) and discover the side effects of the transfer learning. Our findings reveal that performance improvements often defy explanations based on surface-level dataset similarity or source data quality. Instead, hidden statistical factors of the source dataset, such as class distribution and generation length proclivities, alongside specific linguistic features, are actually more influential. This work offers insights into the complex dynamics of transfer learning, paving the way for more predictable and effective LLM adaptation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_13624 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Latent Traits and Cross-Task Transfer: Deconstructing Dataset Interactions in LLM Fine-tuning Krishna, Shambhavi Naik, Atharva Agarwal, Chaitali Govindan, Sudharshan Lee, Taesung Chang, Haw-Shiuan Computation and Language Machine Learning Large language models are increasingly deployed across diverse applications. This often includes tasks LLMs have not encountered during training. This implies that enumerating and obtaining the high-quality training data for all tasks is infeasible. Thus, we often need to rely on transfer learning using datasets with different characteristics, and anticipate out-of-distribution requests. Motivated by this practical need, we propose an analysis framework, building a transfer learning matrix and dimensionality reduction, to dissect these cross-task interactions. We train and analyze 10 models to identify latent abilities (e.g., Reasoning, Sentiment Classification, NLU, Arithmetic) and discover the side effects of the transfer learning. Our findings reveal that performance improvements often defy explanations based on surface-level dataset similarity or source data quality. Instead, hidden statistical factors of the source dataset, such as class distribution and generation length proclivities, alongside specific linguistic features, are actually more influential. This work offers insights into the complex dynamics of transfer learning, paving the way for more predictable and effective LLM adaptation. |
| title | Latent Traits and Cross-Task Transfer: Deconstructing Dataset Interactions in LLM Fine-tuning |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2509.13624 |