Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2402.05123 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908504068980736 |
|---|---|
| author | Zhang, Bolin Wang, Jiahao Du, Qianlong Zhang, Jiajun Tu, Zhiying Chu, Dianhui |
| author_facet | Zhang, Bolin Wang, Jiahao Du, Qianlong Zhang, Jiajun Tu, Zhiying Chu, Dianhui |
| contents | Instruction tuning is a vital step of training large language models (LLMs), so how to enhance the effect of instruction tuning has received increased attention. Existing works indicate that the quality of the dataset is more crucial than the quantity during instruction tuning of LLMs. Therefore, recently a lot of studies focus on exploring the methods of selecting high-quality subset from instruction datasets, aiming to reduce training costs and enhance the instruction-following capabilities of LLMs. This paper presents a comprehensive survey on data selection for LLM instruction tuning. Firstly, we introduce the wildly used instruction datasets. Then, we propose a new taxonomy of the data selection methods and provide a detailed introduction of recent advances, and the evaluation strategies and results of data selection methods are also elaborated in detail. Finally, we emphasize the open challenges and present new frontiers of this task. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_05123 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Survey on Data Selection for LLM Instruction Tuning Zhang, Bolin Wang, Jiahao Du, Qianlong Zhang, Jiajun Tu, Zhiying Chu, Dianhui Computation and Language Instruction tuning is a vital step of training large language models (LLMs), so how to enhance the effect of instruction tuning has received increased attention. Existing works indicate that the quality of the dataset is more crucial than the quantity during instruction tuning of LLMs. Therefore, recently a lot of studies focus on exploring the methods of selecting high-quality subset from instruction datasets, aiming to reduce training costs and enhance the instruction-following capabilities of LLMs. This paper presents a comprehensive survey on data selection for LLM instruction tuning. Firstly, we introduce the wildly used instruction datasets. Then, we propose a new taxonomy of the data selection methods and provide a detailed introduction of recent advances, and the evaluation strategies and results of data selection methods are also elaborated in detail. Finally, we emphasize the open challenges and present new frontiers of this task. |
| title | A Survey on Data Selection for LLM Instruction Tuning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2402.05123 |