CIDAR: Culturally Relevant Instruction Dataset For Arabic
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916115796459520 |
|---|---|
| author | Alyafeai, Zaid Almubarak, Khalid Ashraf, Ahmed Alnuhait, Deema Alshahrani, Saied Abdulrahman, Gubran A. Q. Ahmed, Gamil Gawah, Qais Saleh, Zead Ghaleb, Mustafa Ali, Yousef Al-Shaibani, Maged S. |
| author_facet | Alyafeai, Zaid Almubarak, Khalid Ashraf, Ahmed Alnuhait, Deema Alshahrani, Saied Abdulrahman, Gubran A. Q. Ahmed, Gamil Gawah, Qais Saleh, Zead Ghaleb, Mustafa Ali, Yousef Al-Shaibani, Maged S. |
| contents | Instruction tuning has emerged as a prominent methodology for teaching Large Language Models (LLMs) to follow instructions. However, current instruction datasets predominantly cater to English or are derived from English-dominated LLMs, resulting in inherent biases toward Western culture. This bias significantly impacts the linguistic structures of non-English languages such as Arabic, which has a distinct grammar reflective of the diverse cultures across the Arab region. This paper addresses this limitation by introducing CIDAR: https://hf.co/datasets/arbml/CIDAR, the first open Arabic instruction-tuning dataset culturally-aligned by human reviewers. CIDAR contains 10,000 instruction and output pairs that represent the Arab region. We discuss the cultural relevance of CIDAR via the analysis and comparison to other models fine-tuned on other datasets. Our experiments show that CIDAR can help enrich research efforts in aligning LLMs with the Arabic culture. All the code is available at https://github.com/ARBML/CIDAR. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_03177 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CIDAR: Culturally Relevant Instruction Dataset For Arabic Alyafeai, Zaid Almubarak, Khalid Ashraf, Ahmed Alnuhait, Deema Alshahrani, Saied Abdulrahman, Gubran A. Q. Ahmed, Gamil Gawah, Qais Saleh, Zead Ghaleb, Mustafa Ali, Yousef Al-Shaibani, Maged S. Computation and Language Machine Learning Instruction tuning has emerged as a prominent methodology for teaching Large Language Models (LLMs) to follow instructions. However, current instruction datasets predominantly cater to English or are derived from English-dominated LLMs, resulting in inherent biases toward Western culture. This bias significantly impacts the linguistic structures of non-English languages such as Arabic, which has a distinct grammar reflective of the diverse cultures across the Arab region. This paper addresses this limitation by introducing CIDAR: https://hf.co/datasets/arbml/CIDAR, the first open Arabic instruction-tuning dataset culturally-aligned by human reviewers. CIDAR contains 10,000 instruction and output pairs that represent the Arab region. We discuss the cultural relevance of CIDAR via the analysis and comparison to other models fine-tuned on other datasets. Our experiments show that CIDAR can help enrich research efforts in aligning LLMs with the Arabic culture. All the code is available at https://github.com/ARBML/CIDAR. |
| title | CIDAR: Culturally Relevant Instruction Dataset For Arabic |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2402.03177 |