S2vNTM: Semi-supervised vMF Neural Topic Modeling
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914670856634368 |
|---|---|
| author | Xu, Weijie Desai, Jay Sengamedu, Srinivasan Jiang, Xiaoyu Iannacci, Francis |
| author_facet | Xu, Weijie Desai, Jay Sengamedu, Srinivasan Jiang, Xiaoyu Iannacci, Francis |
| contents | Language model based methods are powerful techniques for text classification. However, the models have several shortcomings. (1) It is difficult to integrate human knowledge such as keywords. (2) It needs a lot of resources to train the models. (3) It relied on large text data to pretrain. In this paper, we propose Semi-Supervised vMF Neural Topic Modeling (S2vNTM) to overcome these difficulties. S2vNTM takes a few seed keywords as input for topics. S2vNTM leverages the pattern of keywords to identify potential topics, as well as optimize the quality of topics' keywords sets. Across a variety of datasets, S2vNTM outperforms existing semi-supervised topic modeling methods in classification accuracy with limited keywords provided. S2vNTM is at least twice as fast as baselines. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_04804 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | S2vNTM: Semi-supervised vMF Neural Topic Modeling Xu, Weijie Desai, Jay Sengamedu, Srinivasan Jiang, Xiaoyu Iannacci, Francis Computation and Language Artificial Intelligence 68T50 I.2.7 Language model based methods are powerful techniques for text classification. However, the models have several shortcomings. (1) It is difficult to integrate human knowledge such as keywords. (2) It needs a lot of resources to train the models. (3) It relied on large text data to pretrain. In this paper, we propose Semi-Supervised vMF Neural Topic Modeling (S2vNTM) to overcome these difficulties. S2vNTM takes a few seed keywords as input for topics. S2vNTM leverages the pattern of keywords to identify potential topics, as well as optimize the quality of topics' keywords sets. Across a variety of datasets, S2vNTM outperforms existing semi-supervised topic modeling methods in classification accuracy with limited keywords provided. S2vNTM is at least twice as fast as baselines. |
| title | S2vNTM: Semi-supervised vMF Neural Topic Modeling |
| topic | Computation and Language Artificial Intelligence 68T50 I.2.7 |
| url | https://arxiv.org/abs/2307.04804 |