Named Entity Recognition for the Kurdish Sorani Language: Dataset Creation and Comparative Analysis
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917110106554368 |
|---|---|
| author | Abdalla, Bakhtawar Nabi, Rebwar Mala Eshkiki, Hassan Caraffini, Fabio |
| author_facet | Abdalla, Bakhtawar Nabi, Rebwar Mala Eshkiki, Hassan Caraffini, Fabio |
| contents | This work contributes towards balancing the inclusivity and global applicability of natural language processing techniques by proposing the first 'name entity recognition' dataset for Kurdish Sorani, a low-resource and under-represented language, that consists of 64,563 annotated tokens. It also provides a tool for facilitating this task in this and many other languages and performs a thorough comparative analysis, including classic machine learning models and neural systems. The results obtained challenge established assumptions about the advantage of neural approaches within the context of NLP. Conventional methods, in particular CRF, obtain F1-scores of 0.825, outperforming the results of BiLSTM-based models (0.706) significantly. These findings indicate that simpler and more computationally efficient classical frameworks can outperform neural architectures in low-resource settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_22315 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Named Entity Recognition for the Kurdish Sorani Language: Dataset Creation and Comparative Analysis Abdalla, Bakhtawar Nabi, Rebwar Mala Eshkiki, Hassan Caraffini, Fabio Computation and Language This work contributes towards balancing the inclusivity and global applicability of natural language processing techniques by proposing the first 'name entity recognition' dataset for Kurdish Sorani, a low-resource and under-represented language, that consists of 64,563 annotated tokens. It also provides a tool for facilitating this task in this and many other languages and performs a thorough comparative analysis, including classic machine learning models and neural systems. The results obtained challenge established assumptions about the advantage of neural approaches within the context of NLP. Conventional methods, in particular CRF, obtain F1-scores of 0.825, outperforming the results of BiLSTM-based models (0.706) significantly. These findings indicate that simpler and more computationally efficient classical frameworks can outperform neural architectures in low-resource settings. |
| title | Named Entity Recognition for the Kurdish Sorani Language: Dataset Creation and Comparative Analysis |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2511.22315 |