Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866929286435307520 |
|---|---|
| author | Xie, Roy Ahia, Orevaoghene Tsvetkov, Yulia Anastasopoulos, Antonios |
| author_facet | Xie, Roy Ahia, Orevaoghene Tsvetkov, Yulia Anastasopoulos, Antonios |
| contents | Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis. This is largely due to the complexity and nuance involved in studying various dialects. We present a novel approach to extract distinguishing lexical features of dialects by utilizing interpretable dialect classifiers, even in the absence of human experts. We explore both post-hoc and intrinsic approaches to interpretability, conduct experiments on Mandarin, Italian, and Low Saxon, and experimentally demonstrate that our method successfully identifies key language-specific lexical features that contribute to dialectal variations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_17914 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers Xie, Roy Ahia, Orevaoghene Tsvetkov, Yulia Anastasopoulos, Antonios Computation and Language Artificial Intelligence Identifying linguistic differences between dialects of a language often requires expert knowledge and meticulous human analysis. This is largely due to the complexity and nuance involved in studying various dialects. We present a novel approach to extract distinguishing lexical features of dialects by utilizing interpretable dialect classifiers, even in the absence of human experts. We explore both post-hoc and intrinsic approaches to interpretability, conduct experiments on Mandarin, Italian, and Low Saxon, and experimentally demonstrate that our method successfully identifies key language-specific lexical features that contribute to dialectal variations. |
| title | Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2402.17914 |