EuSQuAD: Automatically Translated and Aligned SQuAD2.0 for Basque

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: García-Pablos, Aitor, Perez, Naiara, Cuadros, Montse, Bengoetxea, Jaione
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909216457883648
author García-Pablos, Aitor
Perez, Naiara
Cuadros, Montse
Bengoetxea, Jaione
author_facet García-Pablos, Aitor
Perez, Naiara
Cuadros, Montse
Bengoetxea, Jaione
contents The widespread availability of Question Answering (QA) datasets in English has greatly facilitated the advancement of the Natural Language Processing (NLP) field. However, the scarcity of such resources for minority languages, such as Basque, poses a substantial challenge for these communities. In this context, the translation and alignment of existing QA datasets plays a crucial role in narrowing this technological gap. This work presents EuSQuAD, the first initiative dedicated to automatically translating and aligning SQuAD2.0 into Basque, resulting in more than 142k QA examples. We demonstrate EuSQuAD's value through extensive qualitative analysis and QA experiments supported with EuSQuAD as training data. These experiments are evaluated with a new human-annotated dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2404_12177
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle EuSQuAD: Automatically Translated and Aligned SQuAD2.0 for Basque
García-Pablos, Aitor
Perez, Naiara
Cuadros, Montse
Bengoetxea, Jaione
Computation and Language
The widespread availability of Question Answering (QA) datasets in English has greatly facilitated the advancement of the Natural Language Processing (NLP) field. However, the scarcity of such resources for minority languages, such as Basque, poses a substantial challenge for these communities. In this context, the translation and alignment of existing QA datasets plays a crucial role in narrowing this technological gap. This work presents EuSQuAD, the first initiative dedicated to automatically translating and aligning SQuAD2.0 into Basque, resulting in more than 142k QA examples. We demonstrate EuSQuAD's value through extensive qualitative analysis and QA experiments supported with EuSQuAD as training data. These experiments are evaluated with a new human-annotated dataset.
title EuSQuAD: Automatically Translated and Aligned SQuAD2.0 for Basque
topic Computation and Language
url https://arxiv.org/abs/2404.12177