ImbaGCD: Imbalanced Generalized Category Discovery

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Ziyun, Dai, Ben, Simsek, Furkan, Meinel, Christoph, Yang, Haojin
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916087136780288
author Li, Ziyun
Dai, Ben
Simsek, Furkan
Meinel, Christoph
Yang, Haojin
author_facet Li, Ziyun
Dai, Ben
Simsek, Furkan
Meinel, Christoph
Yang, Haojin
contents Generalized class discovery (GCD) aims to infer known and unknown categories in an unlabeled dataset leveraging prior knowledge of a labeled set comprising known classes. Existing research implicitly/explicitly assumes that the frequency of occurrence for each category, whether known or unknown, is approximately the same in the unlabeled data. However, in nature, we are more likely to encounter known/common classes than unknown/uncommon ones, according to the long-tailed property of visual classes. Therefore, we present a challenging and practical problem, Imbalanced Generalized Category Discovery (ImbaGCD), where the distribution of unlabeled data is imbalanced, with known classes being more frequent than unknown ones. To address these issues, we propose ImbaGCD, A novel optimal transport-based expectation maximization framework that accomplishes generalized category discovery by aligning the marginal class prior distribution. ImbaGCD also incorporates a systematic mechanism for estimating the imbalanced class prior distribution under the GCD setup. Our comprehensive experiments reveal that ImbaGCD surpasses previous state-of-the-art GCD methods by achieving an improvement of approximately 2 - 4% on CIFAR-100 and 15 - 19% on ImageNet-100, indicating its superior effectiveness in solving the Imbalanced GCD problem.
format Preprint
id arxiv_https___arxiv_org_abs_2401_05353
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle ImbaGCD: Imbalanced Generalized Category Discovery
Li, Ziyun
Dai, Ben
Simsek, Furkan
Meinel, Christoph
Yang, Haojin
Computer Vision and Pattern Recognition
Machine Learning
Generalized class discovery (GCD) aims to infer known and unknown categories in an unlabeled dataset leveraging prior knowledge of a labeled set comprising known classes. Existing research implicitly/explicitly assumes that the frequency of occurrence for each category, whether known or unknown, is approximately the same in the unlabeled data. However, in nature, we are more likely to encounter known/common classes than unknown/uncommon ones, according to the long-tailed property of visual classes. Therefore, we present a challenging and practical problem, Imbalanced Generalized Category Discovery (ImbaGCD), where the distribution of unlabeled data is imbalanced, with known classes being more frequent than unknown ones. To address these issues, we propose ImbaGCD, A novel optimal transport-based expectation maximization framework that accomplishes generalized category discovery by aligning the marginal class prior distribution. ImbaGCD also incorporates a systematic mechanism for estimating the imbalanced class prior distribution under the GCD setup. Our comprehensive experiments reveal that ImbaGCD surpasses previous state-of-the-art GCD methods by achieving an improvement of approximately 2 - 4% on CIFAR-100 and 15 - 19% on ImageNet-100, indicating its superior effectiveness in solving the Imbalanced GCD problem.
title ImbaGCD: Imbalanced Generalized Category Discovery
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2401.05353