Labeled Data Selection for Category Discovery

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhao, Bingchen, Lang, Nico, Belongie, Serge, Mac Aodha, Oisin
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909261365248000
author Zhao, Bingchen
Lang, Nico
Belongie, Serge
Mac Aodha, Oisin
author_facet Zhao, Bingchen
Lang, Nico
Belongie, Serge
Mac Aodha, Oisin
contents Category discovery methods aim to find novel categories in unlabeled visual data. At training time, a set of labeled and unlabeled images are provided, where the labels correspond to the categories present in the images. The labeled data provides guidance during training by indicating what types of visual properties and features are relevant for performing discovery in the unlabeled data. As a result, changing the categories present in the labeled set can have a large impact on what is ultimately discovered in the unlabeled set. Despite its importance, the impact of labeled data selection has not been explored in the category discovery literature to date. We show that changing the labeled data can significantly impact discovery performance. Motivated by this, we propose two new approaches for automatically selecting the most suitable labeled data based on the similarity between the labeled and unlabeled data. Our observation is that, unlike in conventional supervised transfer learning, the best labeled is neither too similar, nor too dissimilar, to the unlabeled categories. Our resulting approaches obtains state-of-the-art discovery performance across a range of challenging fine-grained benchmark datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2406_04898
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Labeled Data Selection for Category Discovery
Zhao, Bingchen
Lang, Nico
Belongie, Serge
Mac Aodha, Oisin
Computer Vision and Pattern Recognition
Category discovery methods aim to find novel categories in unlabeled visual data. At training time, a set of labeled and unlabeled images are provided, where the labels correspond to the categories present in the images. The labeled data provides guidance during training by indicating what types of visual properties and features are relevant for performing discovery in the unlabeled data. As a result, changing the categories present in the labeled set can have a large impact on what is ultimately discovered in the unlabeled set. Despite its importance, the impact of labeled data selection has not been explored in the category discovery literature to date. We show that changing the labeled data can significantly impact discovery performance. Motivated by this, we propose two new approaches for automatically selecting the most suitable labeled data based on the similarity between the labeled and unlabeled data. Our observation is that, unlike in conventional supervised transfer learning, the best labeled is neither too similar, nor too dissimilar, to the unlabeled categories. Our resulting approaches obtains state-of-the-art discovery performance across a range of challenging fine-grained benchmark datasets.
title Labeled Data Selection for Category Discovery
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.04898