Joint Out-of-Distribution Filtering and Data Discovery Active Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Schmidt, Sebastian, Schenk, Leonard, Schwinn, Leo, Günnemann, Stephan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916642610479104
author Schmidt, Sebastian
Schenk, Leonard
Schwinn, Leo
Günnemann, Stephan
author_facet Schmidt, Sebastian
Schenk, Leonard
Schwinn, Leo
Günnemann, Stephan
contents As the data demand for deep learning models increases, active learning (AL) becomes essential to strategically select samples for labeling, which maximizes data efficiency and reduces training costs. Real-world scenarios necessitate the consideration of incomplete data knowledge within AL. Prior works address handling out-of-distribution (OOD) data, while another research direction has focused on category discovery. However, a combined analysis of real-world considerations combining AL with out-of-distribution data and category discovery remains unexplored. To address this gap, we propose Joint Out-of-distribution filtering and data Discovery Active learning (Joda) , to uniquely address both challenges simultaneously by filtering out OOD data before selecting candidates for labeling. In contrast to previous methods, we deeply entangle the training procedure with filter and selection to construct a common feature space that aligns known and novel categories while separating OOD samples. Unlike previous works, Joda is highly efficient and completely omits auxiliary models and training access to the unlabeled pool for filtering or selection. In extensive experiments on 18 configurations and 3 metrics, \ours{} consistently achieves the highest accuracy with the best class discovery to OOD filtering balance compared to state-of-the-art competitor approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2503_02491
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Joint Out-of-Distribution Filtering and Data Discovery Active Learning
Schmidt, Sebastian
Schenk, Leonard
Schwinn, Leo
Günnemann, Stephan
Computer Vision and Pattern Recognition
Machine Learning
As the data demand for deep learning models increases, active learning (AL) becomes essential to strategically select samples for labeling, which maximizes data efficiency and reduces training costs. Real-world scenarios necessitate the consideration of incomplete data knowledge within AL. Prior works address handling out-of-distribution (OOD) data, while another research direction has focused on category discovery. However, a combined analysis of real-world considerations combining AL with out-of-distribution data and category discovery remains unexplored. To address this gap, we propose Joint Out-of-distribution filtering and data Discovery Active learning (Joda) , to uniquely address both challenges simultaneously by filtering out OOD data before selecting candidates for labeling. In contrast to previous methods, we deeply entangle the training procedure with filter and selection to construct a common feature space that aligns known and novel categories while separating OOD samples. Unlike previous works, Joda is highly efficient and completely omits auxiliary models and training access to the unlabeled pool for filtering or selection. In extensive experiments on 18 configurations and 3 metrics, \ours{} consistently achieves the highest accuracy with the best class discovery to OOD filtering balance compared to state-of-the-art competitor approaches.
title Joint Out-of-Distribution Filtering and Data Discovery Active Learning
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2503.02491