Analyzing Semantic Change through Lexical Replacements
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909183995019264 |
|---|---|
| author | Periti, Francesco Cassotti, Pierluigi Dubossarsky, Haim Tahmasebi, Nina |
| author_facet | Periti, Francesco Cassotti, Pierluigi Dubossarsky, Haim Tahmasebi, Nina |
| contents | Modern language models are capable of contextualizing words based on their surrounding context. However, this capability is often compromised due to semantic change that leads to words being used in new, unexpected contexts not encountered during pre-training. In this paper, we model \textit{semantic change} by studying the effect of unexpected contexts introduced by \textit{lexical replacements}. We propose a \textit{replacement schema} where a target word is substituted with lexical replacements of varying relatedness, thus simulating different kinds of semantic change. Furthermore, we leverage the replacement schema as a basis for a novel \textit{interpretable} model for semantic change. We are also the first to evaluate the use of LLaMa for semantic change detection. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_18570 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Analyzing Semantic Change through Lexical Replacements Periti, Francesco Cassotti, Pierluigi Dubossarsky, Haim Tahmasebi, Nina Computation and Language Modern language models are capable of contextualizing words based on their surrounding context. However, this capability is often compromised due to semantic change that leads to words being used in new, unexpected contexts not encountered during pre-training. In this paper, we model \textit{semantic change} by studying the effect of unexpected contexts introduced by \textit{lexical replacements}. We propose a \textit{replacement schema} where a target word is substituted with lexical replacements of varying relatedness, thus simulating different kinds of semantic change. Furthermore, we leverage the replacement schema as a basis for a novel \textit{interpretable} model for semantic change. We are also the first to evaluate the use of LLaMa for semantic change detection. |
| title | Analyzing Semantic Change through Lexical Replacements |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2404.18570 |