Refining Dimensions for Improving Clustering-based Cross-lingual Topic Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910748075098112 |
|---|---|
| author | Chang, Chia-Hsuan Huang, Tien-Yuan Tsai, Yi-Hang Chang, Chia-Ming Hwang, San-Yih |
| author_facet | Chang, Chia-Hsuan Huang, Tien-Yuan Tsai, Yi-Hang Chang, Chia-Ming Hwang, San-Yih |
| contents | Recent works in clustering-based topic models perform well in monolingual topic identification by introducing a pipeline to cluster the contextualized representations. However, the pipeline is suboptimal in identifying topics across languages due to the presence of language-dependent dimensions (LDDs) generated by multilingual language models. To address this issue, we introduce a novel, SVD-based dimension refinement component into the pipeline of the clustering-based topic model. This component effectively neutralizes the negative impact of LDDs, enabling the model to accurately identify topics across languages. Our experiments on three datasets demonstrate that the updated pipeline with the dimension refinement component generally outperforms other state-of-the-art cross-lingual topic models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_12433 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Refining Dimensions for Improving Clustering-based Cross-lingual Topic Models Chang, Chia-Hsuan Huang, Tien-Yuan Tsai, Yi-Hang Chang, Chia-Ming Hwang, San-Yih Computation and Language Information Retrieval Machine Learning Recent works in clustering-based topic models perform well in monolingual topic identification by introducing a pipeline to cluster the contextualized representations. However, the pipeline is suboptimal in identifying topics across languages due to the presence of language-dependent dimensions (LDDs) generated by multilingual language models. To address this issue, we introduce a novel, SVD-based dimension refinement component into the pipeline of the clustering-based topic model. This component effectively neutralizes the negative impact of LDDs, enabling the model to accurately identify topics across languages. Our experiments on three datasets demonstrate that the updated pipeline with the dimension refinement component generally outperforms other state-of-the-art cross-lingual topic models. |
| title | Refining Dimensions for Improving Clustering-based Cross-lingual Topic Models |
| topic | Computation and Language Information Retrieval Machine Learning |
| url | https://arxiv.org/abs/2412.12433 |