Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2506.19262 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909659684667392 |
|---|---|
| author | Zhu, Yuchang Zhong, Huazhen Lin, Qunshu Wei, Haotong Sun, Xiaolong Yu, Zixuan Liu, Minghao Zheng, Zibin Chen, Liang |
| author_facet | Zhu, Yuchang Zhong, Huazhen Lin, Qunshu Wei, Haotong Sun, Xiaolong Yu, Zixuan Liu, Minghao Zheng, Zibin Chen, Liang |
| contents | With the remarkable generative capabilities of large language models (LLMs), using LLM-generated data to train downstream models has emerged as a promising approach to mitigate data scarcity in specific domains and reduce time-consuming annotations. However, recent studies have highlighted a critical issue: iterative training on self-generated data results in model collapse, where model performance degrades over time. Despite extensive research on the implications of LLM-generated data, these works often neglect the importance of data diversity, a key factor in data quality. In this work, we aim to understand the implications of the diversity of LLM-generated data on downstream model performance. Specifically, we explore how varying levels of diversity in LLM-generated data affect downstream model performance. Additionally, we investigate the performance of models trained on data that mixes different proportions of LLM-generated data, which we refer to as synthetic data. Our experimental results show that, with minimal distribution shift, moderately diverse LLM-generated data can enhance model performance in scenarios with insufficient labeled data, whereas highly diverse generated data has a negative impact. We hope our empirical findings will offer valuable guidance for future studies on LLMs as data generators. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_19262 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | What Matters in LLM-generated Data: Diversity and Its Effect on Model Fine-Tuning Zhu, Yuchang Zhong, Huazhen Lin, Qunshu Wei, Haotong Sun, Xiaolong Yu, Zixuan Liu, Minghao Zheng, Zibin Chen, Liang Computation and Language Machine Learning With the remarkable generative capabilities of large language models (LLMs), using LLM-generated data to train downstream models has emerged as a promising approach to mitigate data scarcity in specific domains and reduce time-consuming annotations. However, recent studies have highlighted a critical issue: iterative training on self-generated data results in model collapse, where model performance degrades over time. Despite extensive research on the implications of LLM-generated data, these works often neglect the importance of data diversity, a key factor in data quality. In this work, we aim to understand the implications of the diversity of LLM-generated data on downstream model performance. Specifically, we explore how varying levels of diversity in LLM-generated data affect downstream model performance. Additionally, we investigate the performance of models trained on data that mixes different proportions of LLM-generated data, which we refer to as synthetic data. Our experimental results show that, with minimal distribution shift, moderately diverse LLM-generated data can enhance model performance in scenarios with insufficient labeled data, whereas highly diverse generated data has a negative impact. We hope our empirical findings will offer valuable guidance for future studies on LLMs as data generators. |
| title | What Matters in LLM-generated Data: Diversity and Its Effect on Model Fine-Tuning |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2506.19262 |