Historia Magistra Vitae: Dynamic Topic Modeling of Roman Literature using Neural Embeddings
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929401712607232 |
|---|---|
| author | Ginn, Michael Hulden, Mans |
| author_facet | Ginn, Michael Hulden, Mans |
| contents | Dynamic topic models have been proposed as a tool for historical analysis, but traditional approaches have had limited usefulness, being difficult to configure, interpret, and evaluate. In this work, we experiment with a recent approach for dynamic topic modeling using BERT embeddings. We compare topic models built using traditional statistical models (LDA and NMF) and the BERT-based model, modeling topics over the entire surviving corpus of Roman literature. We find that while quantitative metrics prefer statistical models, qualitative evaluation finds better insights from the neural model. Furthermore, the neural topic model is less sensitive to hyperparameter configuration and thus may make dynamic topic modeling more viable for historical researchers. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_18907 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Historia Magistra Vitae: Dynamic Topic Modeling of Roman Literature using Neural Embeddings Ginn, Michael Hulden, Mans Computation and Language Dynamic topic models have been proposed as a tool for historical analysis, but traditional approaches have had limited usefulness, being difficult to configure, interpret, and evaluate. In this work, we experiment with a recent approach for dynamic topic modeling using BERT embeddings. We compare topic models built using traditional statistical models (LDA and NMF) and the BERT-based model, modeling topics over the entire surviving corpus of Roman literature. We find that while quantitative metrics prefer statistical models, qualitative evaluation finds better insights from the neural model. Furthermore, the neural topic model is less sensitive to hyperparameter configuration and thus may make dynamic topic modeling more viable for historical researchers. |
| title | Historia Magistra Vitae: Dynamic Topic Modeling of Roman Literature using Neural Embeddings |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.18907 |