TaCIE: Enhancing Instruction Comprehension in Large Language Models through Task-Centred Instruction Evolution
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913530151698432 |
|---|---|
| author | Yang, Jiuding Lu, Shengyao Guo, Weidong Li, Xiangyang Yang, Kaitong Xu, Yu Niu, Di |
| author_facet | Yang, Jiuding Lu, Shengyao Guo, Weidong Li, Xiangyang Yang, Kaitong Xu, Yu Niu, Di |
| contents | Large Language Models (LLMs) require precise alignment with complex instructions to optimize their performance in real-world applications. As the demand for refined instruction tuning data increases, traditional methods that evolve simple seed instructions often struggle to effectively enhance complexity or manage difficulty scaling across various domains. Our innovative approach, Task-Centered Instruction Evolution (TaCIE), addresses these shortcomings by redefining instruction evolution from merely evolving seed instructions to a more dynamic and comprehensive combination of elements. TaCIE starts by deconstructing complex instructions into their fundamental components. It then generates and integrates new elements with the original ones, reassembling them into more sophisticated instructions that progressively increase in difficulty, diversity, and complexity. Applied across multiple domains, LLMs fine-tuned with these evolved instructions have substantially outperformed those tuned with conventional methods, marking a significant advancement in instruction-based model fine-tuning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_02795 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | TaCIE: Enhancing Instruction Comprehension in Large Language Models through Task-Centred Instruction Evolution Yang, Jiuding Lu, Shengyao Guo, Weidong Li, Xiangyang Yang, Kaitong Xu, Yu Niu, Di Computers and Society Artificial Intelligence Computation and Language Large Language Models (LLMs) require precise alignment with complex instructions to optimize their performance in real-world applications. As the demand for refined instruction tuning data increases, traditional methods that evolve simple seed instructions often struggle to effectively enhance complexity or manage difficulty scaling across various domains. Our innovative approach, Task-Centered Instruction Evolution (TaCIE), addresses these shortcomings by redefining instruction evolution from merely evolving seed instructions to a more dynamic and comprehensive combination of elements. TaCIE starts by deconstructing complex instructions into their fundamental components. It then generates and integrates new elements with the original ones, reassembling them into more sophisticated instructions that progressively increase in difficulty, diversity, and complexity. Applied across multiple domains, LLMs fine-tuned with these evolved instructions have substantially outperformed those tuned with conventional methods, marking a significant advancement in instruction-based model fine-tuning. |
| title | TaCIE: Enhancing Instruction Comprehension in Large Language Models through Task-Centred Instruction Evolution |
| topic | Computers and Society Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2410.02795 |