Saved in:
Bibliographic Details
Main Authors: Chen, Changrui, Han, Jungong, Debattista, Kurt
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2312.01169
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910325358460928
author Chen, Changrui
Han, Jungong
Debattista, Kurt
author_facet Chen, Changrui
Han, Jungong
Debattista, Kurt
contents Due to the costliness of labelled data in real-world applications, semi-supervised learning, underpinned by pseudo labelling, is an appealing solution. However, handling confusing samples is nontrivial: discarding valuable confusing samples would compromise the model generalisation while using them for training would exacerbate the issue of confirmation bias caused by the resulting inevitable mislabelling. To solve this problem, this paper proposes to use confusing samples proactively without label correction. Specifically, a Virtual Category (VC) is assigned to each confusing sample in such a way that it can safely contribute to the model optimisation even without a concrete label. This provides an upper bound for inter-class information sharing capacity, which eventually leads to a better embedding space. Extensive experiments on two mainstream dense prediction tasks -- semantic segmentation and object detection, demonstrate that the proposed VC learning significantly surpasses the state-of-the-art, especially when only very few labels are available. Our intriguing findings highlight the usage of VC learning in dense vision tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2312_01169
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Virtual Category Learning: A Semi-Supervised Learning Method for Dense Prediction with Extremely Limited Labels
Chen, Changrui
Han, Jungong
Debattista, Kurt
Computer Vision and Pattern Recognition
Due to the costliness of labelled data in real-world applications, semi-supervised learning, underpinned by pseudo labelling, is an appealing solution. However, handling confusing samples is nontrivial: discarding valuable confusing samples would compromise the model generalisation while using them for training would exacerbate the issue of confirmation bias caused by the resulting inevitable mislabelling. To solve this problem, this paper proposes to use confusing samples proactively without label correction. Specifically, a Virtual Category (VC) is assigned to each confusing sample in such a way that it can safely contribute to the model optimisation even without a concrete label. This provides an upper bound for inter-class information sharing capacity, which eventually leads to a better embedding space. Extensive experiments on two mainstream dense prediction tasks -- semantic segmentation and object detection, demonstrate that the proposed VC learning significantly surpasses the state-of-the-art, especially when only very few labels are available. Our intriguing findings highlight the usage of VC learning in dense vision tasks.
title Virtual Category Learning: A Semi-Supervised Learning Method for Dense Prediction with Extremely Limited Labels
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2312.01169