BanglaQuAD: A Bengali Open-domain Question Answering Dataset
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913544825470976 |
|---|---|
| author | Rony, Md Rashad Al Hasan Shaha, Sudipto Kumar Hasan, Rakib Al Dey, Sumon Kanti Rafi, Amzad Hossain Rafi, Amzad Hossain Sirajee, Ashraf Hasan Lehmann, Jens |
| author_facet | Rony, Md Rashad Al Hasan Shaha, Sudipto Kumar Hasan, Rakib Al Dey, Sumon Kanti Rafi, Amzad Hossain Rafi, Amzad Hossain Sirajee, Ashraf Hasan Lehmann, Jens |
| contents | Bengali is the seventh most spoken language on earth, yet considered a low-resource language in the field of natural language processing (NLP). Question answering over unstructured text is a challenging NLP task as it requires understanding both question and passage. Very few researchers attempted to perform question answering over Bengali (natively pronounced as Bangla) text. Typically, existing approaches construct the dataset by directly translating them from English to Bengali, which produces noisy and improper sentence structures. Furthermore, they lack topics and terminologies related to the Bengali language and people. This paper introduces BanglaQuAD, a Bengali question answering dataset, containing 30,808 question-answer pairs constructed from Bengali Wikipedia articles by native speakers. Additionally, we propose an annotation tool that facilitates question-answering dataset construction on a local machine. A qualitative analysis demonstrates the quality of our proposed dataset. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_10229 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | BanglaQuAD: A Bengali Open-domain Question Answering Dataset Rony, Md Rashad Al Hasan Shaha, Sudipto Kumar Hasan, Rakib Al Dey, Sumon Kanti Rafi, Amzad Hossain Rafi, Amzad Hossain Sirajee, Ashraf Hasan Lehmann, Jens Computation and Language Artificial Intelligence Bengali is the seventh most spoken language on earth, yet considered a low-resource language in the field of natural language processing (NLP). Question answering over unstructured text is a challenging NLP task as it requires understanding both question and passage. Very few researchers attempted to perform question answering over Bengali (natively pronounced as Bangla) text. Typically, existing approaches construct the dataset by directly translating them from English to Bengali, which produces noisy and improper sentence structures. Furthermore, they lack topics and terminologies related to the Bengali language and people. This paper introduces BanglaQuAD, a Bengali question answering dataset, containing 30,808 question-answer pairs constructed from Bengali Wikipedia articles by native speakers. Additionally, we propose an annotation tool that facilitates question-answering dataset construction on a local machine. A qualitative analysis demonstrates the quality of our proposed dataset. |
| title | BanglaQuAD: A Bengali Open-domain Question Answering Dataset |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2410.10229 |