EasyInstruct: An Easy-to-use Instruction Processing Framework for Large Language Models
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916298457350144 |
|---|---|
| author | Ou, Yixin Zhang, Ningyu Gui, Honghao Xu, Ziwen Qiao, Shuofei Xue, Yida Fang, Runnan Liu, Kangwei Li, Lei Bi, Zhen Zheng, Guozhou Chen, Huajun |
| author_facet | Ou, Yixin Zhang, Ningyu Gui, Honghao Xu, Ziwen Qiao, Shuofei Xue, Yida Fang, Runnan Liu, Kangwei Li, Lei Bi, Zhen Zheng, Guozhou Chen, Huajun |
| contents | In recent years, instruction tuning has gained increasing attention and emerged as a crucial technique to enhance the capabilities of Large Language Models (LLMs). To construct high-quality instruction datasets, many instruction processing approaches have been proposed, aiming to achieve a delicate balance between data quantity and data quality. Nevertheless, due to inconsistencies that persist among various instruction processing methods, there is no standard open-source instruction processing implementation framework available for the community, which hinders practitioners from further developing and advancing. To facilitate instruction processing research and development, we present EasyInstruct, an easy-to-use instruction processing framework for LLMs, which modularizes instruction generation, selection, and prompting, while also considering their combination and interaction. EasyInstruct is publicly released and actively maintained at https://github.com/zjunlp/EasyInstruct, along with an online demo app and a demo video for quick-start, calling for broader research centered on instruction data and synthetic data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_03049 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | EasyInstruct: An Easy-to-use Instruction Processing Framework for Large Language Models Ou, Yixin Zhang, Ningyu Gui, Honghao Xu, Ziwen Qiao, Shuofei Xue, Yida Fang, Runnan Liu, Kangwei Li, Lei Bi, Zhen Zheng, Guozhou Chen, Huajun Computation and Language Artificial Intelligence Human-Computer Interaction Information Retrieval Machine Learning In recent years, instruction tuning has gained increasing attention and emerged as a crucial technique to enhance the capabilities of Large Language Models (LLMs). To construct high-quality instruction datasets, many instruction processing approaches have been proposed, aiming to achieve a delicate balance between data quantity and data quality. Nevertheless, due to inconsistencies that persist among various instruction processing methods, there is no standard open-source instruction processing implementation framework available for the community, which hinders practitioners from further developing and advancing. To facilitate instruction processing research and development, we present EasyInstruct, an easy-to-use instruction processing framework for LLMs, which modularizes instruction generation, selection, and prompting, while also considering their combination and interaction. EasyInstruct is publicly released and actively maintained at https://github.com/zjunlp/EasyInstruct, along with an online demo app and a demo video for quick-start, calling for broader research centered on instruction data and synthetic data. |
| title | EasyInstruct: An Easy-to-use Instruction Processing Framework for Large Language Models |
| topic | Computation and Language Artificial Intelligence Human-Computer Interaction Information Retrieval Machine Learning |
| url | https://arxiv.org/abs/2402.03049 |