Pairing Orthographically Variant Literary Words to Standard Equivalents Using Neural Edit Distance Models
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911452032401408 |
|---|---|
| author | Messner, Craig Lippincott, Tom |
| author_facet | Messner, Craig Lippincott, Tom |
| contents | We present a novel corpus consisting of orthographically variant words found in works of 19th century U.S. literature annotated with their corresponding "standard" word pair. We train a set of neural edit distance models to pair these variants with their standard forms, and compare the performance of these models to the performance of a set of neural edit distance models trained on a corpus of orthographic errors made by L2 English learners. Finally, we analyze the relative performance of these models in the light of different negative training sample generation strategies, and offer concluding remarks on the unique challenge literary orthographic variation poses to string pairing methodologies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_15068 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Pairing Orthographically Variant Literary Words to Standard Equivalents Using Neural Edit Distance Models Messner, Craig Lippincott, Tom Computation and Language We present a novel corpus consisting of orthographically variant words found in works of 19th century U.S. literature annotated with their corresponding "standard" word pair. We train a set of neural edit distance models to pair these variants with their standard forms, and compare the performance of these models to the performance of a set of neural edit distance models trained on a corpus of orthographic errors made by L2 English learners. Finally, we analyze the relative performance of these models in the light of different negative training sample generation strategies, and offer concluding remarks on the unique challenge literary orthographic variation poses to string pairing methodologies. |
| title | Pairing Orthographically Variant Literary Words to Standard Equivalents Using Neural Edit Distance Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2401.15068 |