Document Set Expansion with Positive-Unlabeled Learning: A Density Estimation-based Approach
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913202332237824 |
|---|---|
| author | Zhang, Haiyang Chen, Qiuyi Zou, Yuanjie Pan, Yushan Wang, Jia Stevenson, Mark |
| author_facet | Zhang, Haiyang Chen, Qiuyi Zou, Yuanjie Pan, Yushan Wang, Jia Stevenson, Mark |
| contents | Document set expansion aims to identify relevant documents from a large collection based on a small set of documents that are on a fine-grained topic. Previous work shows that PU learning is a promising method for this task. However, some serious issues remain unresolved, i.e. typical challenges that PU methods suffer such as unknown class prior and imbalanced data, and the need for transductive experimental settings. In this paper, we propose a novel PU learning framework based on density estimation, called puDE, that can handle the above issues. The advantage of puDE is that it neither constrained to the SCAR assumption and nor require any class prior knowledge. We demonstrate the effectiveness of the proposed method using a series of real-world datasets and conclude that our method is a better alternative for the DSE task. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_11145 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Document Set Expansion with Positive-Unlabeled Learning: A Density Estimation-based Approach Zhang, Haiyang Chen, Qiuyi Zou, Yuanjie Pan, Yushan Wang, Jia Stevenson, Mark Machine Learning Information Retrieval Document set expansion aims to identify relevant documents from a large collection based on a small set of documents that are on a fine-grained topic. Previous work shows that PU learning is a promising method for this task. However, some serious issues remain unresolved, i.e. typical challenges that PU methods suffer such as unknown class prior and imbalanced data, and the need for transductive experimental settings. In this paper, we propose a novel PU learning framework based on density estimation, called puDE, that can handle the above issues. The advantage of puDE is that it neither constrained to the SCAR assumption and nor require any class prior knowledge. We demonstrate the effectiveness of the proposed method using a series of real-world datasets and conclude that our method is a better alternative for the DSE task. |
| title | Document Set Expansion with Positive-Unlabeled Learning: A Density Estimation-based Approach |
| topic | Machine Learning Information Retrieval |
| url | https://arxiv.org/abs/2401.11145 |