Saved in:
Bibliographic Details
Main Authors: Thomas, Jake, Houssineau, Jeremie
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.08225
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910739801833472
author Thomas, Jake
Houssineau, Jeremie
author_facet Thomas, Jake
Houssineau, Jeremie
contents A popular strategy for active learning is to specifically target a reduction in epistemic uncertainty, since aleatoric uncertainty is often considered as being intrinsic to the system of interest and therefore not reducible. Yet, distinguishing these two types of uncertainty remains challenging and there is no single strategy that consistently outperforms the others. We propose to use a particular combination of probability and possibility theories, with the aim of using the latter to specifically represent epistemic uncertainty, and we show how this combination leads to new active learning strategies that have desirable properties. In order to demonstrate the efficiency of these strategies in non-trivial settings, we introduce the notion of a possibilistic Gaussian process (GP) and consider GP-based multiclass and binary classification problems, for which the proposed methods display a strong performance for both simulated and real datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2412_08225
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Improving Active Learning with a Bayesian Representation of Epistemic Uncertainty
Thomas, Jake
Houssineau, Jeremie
Methodology
Machine Learning
A popular strategy for active learning is to specifically target a reduction in epistemic uncertainty, since aleatoric uncertainty is often considered as being intrinsic to the system of interest and therefore not reducible. Yet, distinguishing these two types of uncertainty remains challenging and there is no single strategy that consistently outperforms the others. We propose to use a particular combination of probability and possibility theories, with the aim of using the latter to specifically represent epistemic uncertainty, and we show how this combination leads to new active learning strategies that have desirable properties. In order to demonstrate the efficiency of these strategies in non-trivial settings, we introduce the notion of a possibilistic Gaussian process (GP) and consider GP-based multiclass and binary classification problems, for which the proposed methods display a strong performance for both simulated and real datasets.
title Improving Active Learning with a Bayesian Representation of Epistemic Uncertainty
topic Methodology
Machine Learning
url https://arxiv.org/abs/2412.08225