Saved in:
Bibliographic Details
Main Authors: Nowak, Krzysztof, Ziębura, Jędrzej, Wróbel, Krzysztof, Smywiński-Pohl, Aleksander
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.00418
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911938250801152
author Nowak, Krzysztof
Ziębura, Jędrzej
Wróbel, Krzysztof
Smywiński-Pohl, Aleksander
author_facet Nowak, Krzysztof
Ziębura, Jędrzej
Wróbel, Krzysztof
Smywiński-Pohl, Aleksander
contents This study introduces the eFontes models for automatic linguistic annotation of Medieval Latin texts, focusing on lemmatization, part-of-speech tagging, and morphological feature determination. Using the Transformers library, these models were trained on Universal Dependencies (UD) corpora and the newly developed eFontes corpus of Polish Medieval Latin. The research evaluates the models' performance, addressing challenges such as orthographic variations and the integration of Latinized vernacular terms. The models achieved high accuracy rates: lemmatization at 92.60%, part-of-speech tagging at 83.29%, and morphological feature determination at 88.57%. The findings underscore the importance of high-quality annotated corpora and propose future enhancements, including extending the models to Named Entity Recognition.
format Preprint
id arxiv_https___arxiv_org_abs_2407_00418
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle eFontes. Part of Speech Tagging and Lemmatization of Medieval Latin Texts.A Cross-Genre Survey
Nowak, Krzysztof
Ziębura, Jędrzej
Wróbel, Krzysztof
Smywiński-Pohl, Aleksander
Computation and Language
Machine Learning
This study introduces the eFontes models for automatic linguistic annotation of Medieval Latin texts, focusing on lemmatization, part-of-speech tagging, and morphological feature determination. Using the Transformers library, these models were trained on Universal Dependencies (UD) corpora and the newly developed eFontes corpus of Polish Medieval Latin. The research evaluates the models' performance, addressing challenges such as orthographic variations and the integration of Latinized vernacular terms. The models achieved high accuracy rates: lemmatization at 92.60%, part-of-speech tagging at 83.29%, and morphological feature determination at 88.57%. The findings underscore the importance of high-quality annotated corpora and propose future enhancements, including extending the models to Named Entity Recognition.
title eFontes. Part of Speech Tagging and Lemmatization of Medieval Latin Texts.A Cross-Genre Survey
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2407.00418