Saved in:
Bibliographic Details
Main Authors: Levine, Lauren, Min, Junghyun, Zeldes, Amir
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2504.18718
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913889506033664
author Levine, Lauren
Min, Junghyun
Zeldes, Amir
author_facet Levine, Lauren
Min, Junghyun
Zeldes, Amir
contents In this paper we present a sample treebank for Old English based on the UD Cairo sentences, collected and annotated as part of a classroom curriculum in Historical Linguistics. To collect the data, a sample of 20 sentences illustrating a range of syntactic constructions in the world's languages, we employ a combination of LLM prompting and searches in authentic Old English data. For annotation we assigned sentences to multiple students with limited prior exposure to UD, whose annotations we compare and adjudicate. Our results suggest that while current LLM outputs in Old English do not reflect authentic syntax, this can be mitigated by post-editing, and that although beginner annotators do not possess enough background to complete the task perfectly, taken together they can produce good results and learn from the experience. We also conduct preliminary parsing experiments using Modern English training data, and find that although performance on Old English is poor, parsing on annotated features (lemma, hyperlemma, gloss) leads to improved performance.
format Preprint
id arxiv_https___arxiv_org_abs_2504_18718
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Building UD Cairo for Old English in the Classroom
Levine, Lauren
Min, Junghyun
Zeldes, Amir
Computation and Language
In this paper we present a sample treebank for Old English based on the UD Cairo sentences, collected and annotated as part of a classroom curriculum in Historical Linguistics. To collect the data, a sample of 20 sentences illustrating a range of syntactic constructions in the world's languages, we employ a combination of LLM prompting and searches in authentic Old English data. For annotation we assigned sentences to multiple students with limited prior exposure to UD, whose annotations we compare and adjudicate. Our results suggest that while current LLM outputs in Old English do not reflect authentic syntax, this can be mitigated by post-editing, and that although beginner annotators do not possess enough background to complete the task perfectly, taken together they can produce good results and learn from the experience. We also conduct preliminary parsing experiments using Modern English training data, and find that although performance on Old English is poor, parsing on annotated features (lemma, hyperlemma, gloss) leads to improved performance.
title Building UD Cairo for Old English in the Classroom
topic Computation and Language
url https://arxiv.org/abs/2504.18718