CLEANANERCorp: Identifying and Correcting Incorrect Labels in the ANERcorp Dataset
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915186905972736 |
|---|---|
| author | Al-Duwais, Mashael Al-Khalifa, Hend Al-Salman, Abdulmalik |
| author_facet | Al-Duwais, Mashael Al-Khalifa, Hend Al-Salman, Abdulmalik |
| contents | Label errors are a common issue in machine learning datasets, particularly for tasks such as Named Entity Recognition. Such label errors might hurt model training, affect evaluation results, and lead to an inaccurate assessment of model performance. In this study, we dived deep into one of the widely adopted Arabic NER benchmark datasets (ANERcorp) and found a significant number of annotation errors, missing labels, and inconsistencies. Therefore, in this study, we conducted empirical research to understand these errors, correct them and propose a cleaner version of the dataset named CLEANANERCorp. CLEANANERCorp will serve the research community as a more accurate and consistent benchmark. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_12362 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CLEANANERCorp: Identifying and Correcting Incorrect Labels in the ANERcorp Dataset Al-Duwais, Mashael Al-Khalifa, Hend Al-Salman, Abdulmalik Computation and Language Label errors are a common issue in machine learning datasets, particularly for tasks such as Named Entity Recognition. Such label errors might hurt model training, affect evaluation results, and lead to an inaccurate assessment of model performance. In this study, we dived deep into one of the widely adopted Arabic NER benchmark datasets (ANERcorp) and found a significant number of annotation errors, missing labels, and inconsistencies. Therefore, in this study, we conducted empirical research to understand these errors, correct them and propose a cleaner version of the dataset named CLEANANERCorp. CLEANANERCorp will serve the research community as a more accurate and consistent benchmark. |
| title | CLEANANERCorp: Identifying and Correcting Incorrect Labels in the ANERcorp Dataset |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2408.12362 |