HistNERo: Historical Named Entity Recognition for the Romanian Language
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929332320993280 |
|---|---|
| author | Avram, Andrei-Marius Iuga, Andreea Manolache, George-Vlad Matei, Vlad-Cristian Micliuş, Răzvan-Gabriel Muntean, Vlad-Andrei Sorlescu, Manuel-Petru Şerban, Dragoş-Andrei Urse, Adrian-Dinu Păiş, Vasile Cercel, Dumitru-Clementin |
| author_facet | Avram, Andrei-Marius Iuga, Andreea Manolache, George-Vlad Matei, Vlad-Cristian Micliuş, Răzvan-Gabriel Muntean, Vlad-Andrei Sorlescu, Manuel-Petru Şerban, Dragoş-Andrei Urse, Adrian-Dinu Păiş, Vasile Cercel, Dumitru-Clementin |
| contents | This work introduces HistNERo, the first Romanian corpus for Named Entity Recognition (NER) in historical newspapers. The dataset contains 323k tokens of text, covering more than half of the 19th century (i.e., 1817) until the late part of the 20th century (i.e., 1990). Eight native Romanian speakers annotated the dataset with five named entities. The samples belong to one of the following four historical regions of Romania, namely Bessarabia, Moldavia, Transylvania, and Wallachia. We employed this proposed dataset to perform several experiments for NER using Romanian pre-trained language models. Our results show that the best model achieved a strict F1-score of 55.69%. Also, by reducing the discrepancies between regions through a novel domain adaption technique, we improved the performance on this corpus to a strict F1-score of 66.80%, representing an absolute gain of more than 10%. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_00155 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | HistNERo: Historical Named Entity Recognition for the Romanian Language Avram, Andrei-Marius Iuga, Andreea Manolache, George-Vlad Matei, Vlad-Cristian Micliuş, Răzvan-Gabriel Muntean, Vlad-Andrei Sorlescu, Manuel-Petru Şerban, Dragoş-Andrei Urse, Adrian-Dinu Păiş, Vasile Cercel, Dumitru-Clementin Computation and Language This work introduces HistNERo, the first Romanian corpus for Named Entity Recognition (NER) in historical newspapers. The dataset contains 323k tokens of text, covering more than half of the 19th century (i.e., 1817) until the late part of the 20th century (i.e., 1990). Eight native Romanian speakers annotated the dataset with five named entities. The samples belong to one of the following four historical regions of Romania, namely Bessarabia, Moldavia, Transylvania, and Wallachia. We employed this proposed dataset to perform several experiments for NER using Romanian pre-trained language models. Our results show that the best model achieved a strict F1-score of 55.69%. Also, by reducing the discrepancies between regions through a novel domain adaption technique, we improved the performance on this corpus to a strict F1-score of 66.80%, representing an absolute gain of more than 10%. |
| title | HistNERo: Historical Named Entity Recognition for the Romanian Language |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2405.00155 |