Specifying What You Know or Not for Multi-Label Class-Incremental Learning

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhang, Aoting, Yang, Dongbao, Liu, Chang, Hong, Xiaopeng, Zhou, Yu
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908276887650304
author Zhang, Aoting
Yang, Dongbao
Liu, Chang
Hong, Xiaopeng
Zhou, Yu
author_facet Zhang, Aoting
Yang, Dongbao
Liu, Chang
Hong, Xiaopeng
Zhou, Yu
contents Existing class incremental learning is mainly designed for single-label classification task, which is ill-equipped for multi-label scenarios due to the inherent contradiction of learning objectives for samples with incomplete labels. We argue that the main challenge to overcome this contradiction in multi-label class-incremental learning (MLCIL) lies in the model's inability to clearly distinguish between known and unknown knowledge. This ambiguity hinders the model's ability to retain historical knowledge, master current classes, and prepare for future learning simultaneously. In this paper, we target at specifying what is known or not to accommodate Historical, Current, and Prospective knowledge for MLCIL and propose a novel framework termed as HCP. Specifically, (i) we clarify the known classes by dynamic feature purification and recall enhancement with distribution prior, enhancing the precision and retention of known information. (ii) We design prospective knowledge mining to probe the unknown, preparing the model for future learning. Extensive experiments validate that our method effectively alleviates catastrophic forgetting in MLCIL, surpassing the previous state-of-the-art by 3.3% on average accuracy for MS-COCO B0-C10 setting without replay buffers.
format Preprint
id arxiv_https___arxiv_org_abs_2503_17017
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Specifying What You Know or Not for Multi-Label Class-Incremental Learning
Zhang, Aoting
Yang, Dongbao
Liu, Chang
Hong, Xiaopeng
Zhou, Yu
Machine Learning
Computer Vision and Pattern Recognition
Existing class incremental learning is mainly designed for single-label classification task, which is ill-equipped for multi-label scenarios due to the inherent contradiction of learning objectives for samples with incomplete labels. We argue that the main challenge to overcome this contradiction in multi-label class-incremental learning (MLCIL) lies in the model's inability to clearly distinguish between known and unknown knowledge. This ambiguity hinders the model's ability to retain historical knowledge, master current classes, and prepare for future learning simultaneously. In this paper, we target at specifying what is known or not to accommodate Historical, Current, and Prospective knowledge for MLCIL and propose a novel framework termed as HCP. Specifically, (i) we clarify the known classes by dynamic feature purification and recall enhancement with distribution prior, enhancing the precision and retention of known information. (ii) We design prospective knowledge mining to probe the unknown, preparing the model for future learning. Extensive experiments validate that our method effectively alleviates catastrophic forgetting in MLCIL, surpassing the previous state-of-the-art by 3.3% on average accuracy for MS-COCO B0-C10 setting without replay buffers.
title Specifying What You Know or Not for Multi-Label Class-Incremental Learning
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.17017