Saved in:
Bibliographic Details
Main Authors: Zhao, Puning, Deng, Jintao, Cheng, Xu
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.01990
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910433595621376
author Zhao, Puning
Deng, Jintao
Cheng, Xu
author_facet Zhao, Puning
Deng, Jintao
Cheng, Xu
contents PU learning refers to the classification problem in which only part of positive samples are labeled. Existing PU learning methods treat unlabeled samples equally. However, in many real tasks, from common sense or domain knowledge, some unlabeled samples are more likely to be positive than others. In this paper, we propose soft label PU learning, in which unlabeled data are assigned soft labels according to their probabilities of being positive. Considering that the ground truth of TPR, FPR, and AUC are unknown, we then design PU counterparts of these metrics to evaluate the performances of soft label PU learning methods within validation data. We show that these new designed PU metrics are good substitutes for the real metrics. After that, a method that optimizes such metrics is proposed. Experiments on public datasets and real datasets for anti-cheat services from Tencent games demonstrate the effectiveness of our proposed method.
format Preprint
id arxiv_https___arxiv_org_abs_2405_01990
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Soft Label PU Learning
Zhao, Puning
Deng, Jintao
Cheng, Xu
Machine Learning
PU learning refers to the classification problem in which only part of positive samples are labeled. Existing PU learning methods treat unlabeled samples equally. However, in many real tasks, from common sense or domain knowledge, some unlabeled samples are more likely to be positive than others. In this paper, we propose soft label PU learning, in which unlabeled data are assigned soft labels according to their probabilities of being positive. Considering that the ground truth of TPR, FPR, and AUC are unknown, we then design PU counterparts of these metrics to evaluate the performances of soft label PU learning methods within validation data. We show that these new designed PU metrics are good substitutes for the real metrics. After that, a method that optimizes such metrics is proposed. Experiments on public datasets and real datasets for anti-cheat services from Tencent games demonstrate the effectiveness of our proposed method.
title Soft Label PU Learning
topic Machine Learning
url https://arxiv.org/abs/2405.01990