Detection of Non-recorded Word Senses in English and Swedish
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910741205876736 |
|---|---|
| author | Lautenschlager, Jonathan Sköldberg, Emma Hengchen, Simon Schlechtweg, Dominik |
| author_facet | Lautenschlager, Jonathan Sköldberg, Emma Hengchen, Simon Schlechtweg, Dominik |
| contents | This study addresses the task of Unknown Sense Detection in English and Swedish. The primary objective of this task is to determine whether the meaning of a particular word usage is documented in a dictionary or not. For this purpose, sense entries are compared with word usages from modern and historical corpora using a pre-trained Word-in-Context embedder that allows us to model this task in a few-shot scenario. Additionally, we use human annotations on the target corpora to adapt hyperparameters and evaluate our models using 5-fold cross-validation. Compared to a random sample from a corpus, our model is able to considerably increase the detected number of word usages with non-recorded senses. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_02285 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Detection of Non-recorded Word Senses in English and Swedish Lautenschlager, Jonathan Sköldberg, Emma Hengchen, Simon Schlechtweg, Dominik Computation and Language This study addresses the task of Unknown Sense Detection in English and Swedish. The primary objective of this task is to determine whether the meaning of a particular word usage is documented in a dictionary or not. For this purpose, sense entries are compared with word usages from modern and historical corpora using a pre-trained Word-in-Context embedder that allows us to model this task in a few-shot scenario. Additionally, we use human annotations on the target corpora to adapt hyperparameters and evaluate our models using 5-fold cross-validation. Compared to a random sample from a corpus, our model is able to considerably increase the detected number of word usages with non-recorded senses. |
| title | Detection of Non-recorded Word Senses in English and Swedish |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2403.02285 |