Noise-Tolerant Hybrid Prototypical Learning with Noisy Web Data

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Liang, Chao, Zhu, Linchao, Yang, Zongxin, Chen, Wei, Yang, Yi
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912177684742144
author Liang, Chao
Zhu, Linchao
Yang, Zongxin
Chen, Wei
Yang, Yi
author_facet Liang, Chao
Zhu, Linchao
Yang, Zongxin
Chen, Wei
Yang, Yi
contents We focus on the challenging problem of learning an unbiased classifier from a large number of potentially relevant but noisily labeled web images given only a few clean labeled images. This problem is particularly practical because it reduces the expensive annotation costs by utilizing freely accessible web images with noisy labels. Typically, prototypes are representative images or features used to classify or identify other images. However, in the few clean and many noisy scenarios, the class prototype can be severely biased due to the presence of irrelevant noisy images. The resulting prototypes are less compact and discriminative, as previous methods do not take into account the diverse range of images in the noisy web image collections. On the other hand, the relation modeling between noisy and clean images is not learned for the class prototype generation in an end-to-end manner, which results in a suboptimal class prototype. In this article, we introduce a similarity maximization loss named SimNoiPro. Our SimNoiPro first generates noise-tolerant hybrid prototypes composed of clean and noise-tolerant prototypes and then pulls them closer to each other. Our approach considers the diversity of noisy images by explicit division and overcomes the optimization discrepancy issue. This enables better relation modeling between clean and noisy images and helps extract judicious information from the noisy image set. The evaluation results on two extended few-shot classification benchmarks confirm that our SimNoiPro outperforms prior methods in measuring image relations and cleaning noisy data.
format Preprint
id arxiv_https___arxiv_org_abs_2501_02476
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Noise-Tolerant Hybrid Prototypical Learning with Noisy Web Data
Liang, Chao
Zhu, Linchao
Yang, Zongxin
Chen, Wei
Yang, Yi
Computer Vision and Pattern Recognition
Machine Learning
We focus on the challenging problem of learning an unbiased classifier from a large number of potentially relevant but noisily labeled web images given only a few clean labeled images. This problem is particularly practical because it reduces the expensive annotation costs by utilizing freely accessible web images with noisy labels. Typically, prototypes are representative images or features used to classify or identify other images. However, in the few clean and many noisy scenarios, the class prototype can be severely biased due to the presence of irrelevant noisy images. The resulting prototypes are less compact and discriminative, as previous methods do not take into account the diverse range of images in the noisy web image collections. On the other hand, the relation modeling between noisy and clean images is not learned for the class prototype generation in an end-to-end manner, which results in a suboptimal class prototype. In this article, we introduce a similarity maximization loss named SimNoiPro. Our SimNoiPro first generates noise-tolerant hybrid prototypes composed of clean and noise-tolerant prototypes and then pulls them closer to each other. Our approach considers the diversity of noisy images by explicit division and overcomes the optimization discrepancy issue. This enables better relation modeling between clean and noisy images and helps extract judicious information from the noisy image set. The evaluation results on two extended few-shot classification benchmarks confirm that our SimNoiPro outperforms prior methods in measuring image relations and cleaning noisy data.
title Noise-Tolerant Hybrid Prototypical Learning with Noisy Web Data
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2501.02476