Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2407.19752 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910545544740864 |
|---|---|
| author | Luo, Tingzhang Du, Mingxuan Shi, Jiatao Chen, Xinxiang Zhao, Bingchen Huang, Shaoguang |
| author_facet | Luo, Tingzhang Du, Mingxuan Shi, Jiatao Chen, Xinxiang Zhao, Bingchen Huang, Shaoguang |
| contents | This paper introduces a novel approach to Generalized Category Discovery (GCD) by leveraging the concept of contextuality to enhance the identification and classification of categories in unlabeled datasets. Drawing inspiration from human cognition's ability to recognize objects within their context, we propose a dual-context based method.
Our model integrates two levels of contextuality: instance-level, where nearest-neighbor contexts are utilized for contrastive learning, and cluster-level, employing prototypical contrastive learning based on category prototypes. The integration of the contextual information effectively improves the feature learning and thereby the classification accuracy of all categories, which better deals with the real-world datasets. Different from the traditional semi-supervised and novel category discovery techniques, our model focuses on a more realistic and challenging scenario where both known and novel categories are present in the unlabeled data. Extensive experimental results on several benchmark data sets demonstrate that the proposed model outperforms the state-of-the-art. Code is available at: https://github.com/Clarence-CV/Contexuality-GCD |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_19752 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Contextuality Helps Representation Learning for Generalized Category Discovery Luo, Tingzhang Du, Mingxuan Shi, Jiatao Chen, Xinxiang Zhao, Bingchen Huang, Shaoguang Computer Vision and Pattern Recognition This paper introduces a novel approach to Generalized Category Discovery (GCD) by leveraging the concept of contextuality to enhance the identification and classification of categories in unlabeled datasets. Drawing inspiration from human cognition's ability to recognize objects within their context, we propose a dual-context based method. Our model integrates two levels of contextuality: instance-level, where nearest-neighbor contexts are utilized for contrastive learning, and cluster-level, employing prototypical contrastive learning based on category prototypes. The integration of the contextual information effectively improves the feature learning and thereby the classification accuracy of all categories, which better deals with the real-world datasets. Different from the traditional semi-supervised and novel category discovery techniques, our model focuses on a more realistic and challenging scenario where both known and novel categories are present in the unlabeled data. Extensive experimental results on several benchmark data sets demonstrate that the proposed model outperforms the state-of-the-art. Code is available at: https://github.com/Clarence-CV/Contexuality-GCD |
| title | Contextuality Helps Representation Learning for Generalized Category Discovery |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2407.19752 |