Saved in:
Bibliographic Details
Main Authors: Zhang, Haiyang, Chen, Qiuyi, Zou, Yuanjie, Pan, Yushan, Wang, Jia, Stevenson, Mark
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.11145
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913202332237824
author Zhang, Haiyang
Chen, Qiuyi
Zou, Yuanjie
Pan, Yushan
Wang, Jia
Stevenson, Mark
author_facet Zhang, Haiyang
Chen, Qiuyi
Zou, Yuanjie
Pan, Yushan
Wang, Jia
Stevenson, Mark
contents Document set expansion aims to identify relevant documents from a large collection based on a small set of documents that are on a fine-grained topic. Previous work shows that PU learning is a promising method for this task. However, some serious issues remain unresolved, i.e. typical challenges that PU methods suffer such as unknown class prior and imbalanced data, and the need for transductive experimental settings. In this paper, we propose a novel PU learning framework based on density estimation, called puDE, that can handle the above issues. The advantage of puDE is that it neither constrained to the SCAR assumption and nor require any class prior knowledge. We demonstrate the effectiveness of the proposed method using a series of real-world datasets and conclude that our method is a better alternative for the DSE task.
format Preprint
id arxiv_https___arxiv_org_abs_2401_11145
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Document Set Expansion with Positive-Unlabeled Learning: A Density Estimation-based Approach
Zhang, Haiyang
Chen, Qiuyi
Zou, Yuanjie
Pan, Yushan
Wang, Jia
Stevenson, Mark
Machine Learning
Information Retrieval
Document set expansion aims to identify relevant documents from a large collection based on a small set of documents that are on a fine-grained topic. Previous work shows that PU learning is a promising method for this task. However, some serious issues remain unresolved, i.e. typical challenges that PU methods suffer such as unknown class prior and imbalanced data, and the need for transductive experimental settings. In this paper, we propose a novel PU learning framework based on density estimation, called puDE, that can handle the above issues. The advantage of puDE is that it neither constrained to the SCAR assumption and nor require any class prior knowledge. We demonstrate the effectiveness of the proposed method using a series of real-world datasets and conclude that our method is a better alternative for the DSE task.
title Document Set Expansion with Positive-Unlabeled Learning: A Density Estimation-based Approach
topic Machine Learning
Information Retrieval
url https://arxiv.org/abs/2401.11145