A Catalog of Basque Dialectal Resources: Online Collections and Standard-to-Dialectal Adaptations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bengoetxea, Jaione, Gonzalez-Dios, Itziar, Agerri, Rodrigo
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908915533348864
author Bengoetxea, Jaione
Gonzalez-Dios, Itziar
Agerri, Rodrigo
author_facet Bengoetxea, Jaione
Gonzalez-Dios, Itziar
Agerri, Rodrigo
contents Recent research on dialectal NLP has identified data scarcity as a primary limitation. To address this limitation, this paper presents a catalog of contemporary Basque dialectal data and resources, offering a systematic and comprehensive compilation of the dialectal data currently available in Basque. Two types of data sources have been distinguished: online data originally written in some dialect, and standard-to-dialect adapted data. The former includes all dialectal data that can be found online, such as news and radio sites, informal tweets, as well as online resources such as dictionaries, atlases, grammar rules, or videos. The latter consists of data that has been adapted from the standard variety to dialectal varieties, either manually or automatically. Regarding the manual adaptation, the test split of the XNLI Natural Language Inference dataset was manually adapted into three Basque dialects: Western, Central, and Navarrese-Lapurdian, yielding a high-quality parallel gold standard evaluation dataset. With respect to the automatic dialectal adaptation, the automatically adapted physical commonsense dataset (BasPhyCowest) underwent additional manual evaluation by native speakers to assess its quality and determine whether it could serve as a viable substitute for full manual adaptation (i.e., silver data creation).
format Preprint
id arxiv_https___arxiv_org_abs_2603_25189
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Catalog of Basque Dialectal Resources: Online Collections and Standard-to-Dialectal Adaptations
Bengoetxea, Jaione
Gonzalez-Dios, Itziar
Agerri, Rodrigo
Computation and Language
Recent research on dialectal NLP has identified data scarcity as a primary limitation. To address this limitation, this paper presents a catalog of contemporary Basque dialectal data and resources, offering a systematic and comprehensive compilation of the dialectal data currently available in Basque. Two types of data sources have been distinguished: online data originally written in some dialect, and standard-to-dialect adapted data. The former includes all dialectal data that can be found online, such as news and radio sites, informal tweets, as well as online resources such as dictionaries, atlases, grammar rules, or videos. The latter consists of data that has been adapted from the standard variety to dialectal varieties, either manually or automatically. Regarding the manual adaptation, the test split of the XNLI Natural Language Inference dataset was manually adapted into three Basque dialects: Western, Central, and Navarrese-Lapurdian, yielding a high-quality parallel gold standard evaluation dataset. With respect to the automatic dialectal adaptation, the automatically adapted physical commonsense dataset (BasPhyCowest) underwent additional manual evaluation by native speakers to assess its quality and determine whether it could serve as a viable substitute for full manual adaptation (i.e., silver data creation).
title A Catalog of Basque Dialectal Resources: Online Collections and Standard-to-Dialectal Adaptations
topic Computation and Language
url https://arxiv.org/abs/2603.25189