Imprecise Label Learning: A Unified Framework for Learning with Various Imprecise Label Configurations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Hao, Shah, Ankit, Wang, Jindong, Tao, Ran, Wang, Yidong, Xie, Xing, Sugiyama, Masashi, Singh, Rita, Raj, Bhiksha
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929567690653696
author Chen, Hao
Shah, Ankit
Wang, Jindong
Tao, Ran
Wang, Yidong
Xie, Xing
Sugiyama, Masashi
Singh, Rita
Raj, Bhiksha
author_facet Chen, Hao
Shah, Ankit
Wang, Jindong
Tao, Ran
Wang, Yidong
Xie, Xing
Sugiyama, Masashi
Singh, Rita
Raj, Bhiksha
contents Learning with reduced labeling standards, such as noisy label, partial label, and multiple label candidates, which we generically refer to as \textit{imprecise} labels, is a commonplace challenge in machine learning tasks. Previous methods tend to propose specific designs for every emerging imprecise label configuration, which is usually unsustainable when multiple configurations of imprecision coexist. In this paper, we introduce imprecise label learning (ILL), a framework for the unification of learning with various imprecise label configurations. ILL leverages expectation-maximization (EM) for modeling the imprecise label information, treating the precise labels as latent variables.Instead of approximating the correct labels for training, it considers the entire distribution of all possible labeling entailed by the imprecise information. We demonstrate that ILL can seamlessly adapt to partial label learning, semi-supervised learning, noisy label learning, and, more importantly, a mixture of these settings. Notably, ILL surpasses the existing specified techniques for handling imprecise labels, marking the first unified framework with robust and effective performance across various challenging settings. We hope our work will inspire further research on this topic, unleashing the full potential of ILL in wider scenarios where precise labels are expensive and complicated to obtain.
format Preprint
id arxiv_https___arxiv_org_abs_2305_12715
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Imprecise Label Learning: A Unified Framework for Learning with Various Imprecise Label Configurations
Chen, Hao
Shah, Ankit
Wang, Jindong
Tao, Ran
Wang, Yidong
Xie, Xing
Sugiyama, Masashi
Singh, Rita
Raj, Bhiksha
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Learning with reduced labeling standards, such as noisy label, partial label, and multiple label candidates, which we generically refer to as \textit{imprecise} labels, is a commonplace challenge in machine learning tasks. Previous methods tend to propose specific designs for every emerging imprecise label configuration, which is usually unsustainable when multiple configurations of imprecision coexist. In this paper, we introduce imprecise label learning (ILL), a framework for the unification of learning with various imprecise label configurations. ILL leverages expectation-maximization (EM) for modeling the imprecise label information, treating the precise labels as latent variables.Instead of approximating the correct labels for training, it considers the entire distribution of all possible labeling entailed by the imprecise information. We demonstrate that ILL can seamlessly adapt to partial label learning, semi-supervised learning, noisy label learning, and, more importantly, a mixture of these settings. Notably, ILL surpasses the existing specified techniques for handling imprecise labels, marking the first unified framework with robust and effective performance across various challenging settings. We hope our work will inspire further research on this topic, unleashing the full potential of ILL in wider scenarios where precise labels are expensive and complicated to obtain.
title Imprecise Label Learning: A Unified Framework for Learning with Various Imprecise Label Configurations
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2305.12715