Class-Independent Increment: An Efficient Approach for Multi-label Class-Incremental Learning

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ding, Chenhao, Dong, Songlin, Zhou, Zhengdong, Han, Jizhou, Wang, Qiang, He, Yuhang, Gong, Yihong
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911287004364800
author Ding, Chenhao
Dong, Songlin
Zhou, Zhengdong
Han, Jizhou
Wang, Qiang
He, Yuhang
Gong, Yihong
author_facet Ding, Chenhao
Dong, Songlin
Zhou, Zhengdong
Han, Jizhou
Wang, Qiang
He, Yuhang
Gong, Yihong
contents Current research on class-incremental learning primarily focuses on single-label classification tasks. However, real-world applications often involve multi-label scenarios, such as image retrieval and medical imaging. Therefore, this paper focuses on the challenging yet practical multi-label class-incremental learning (MLCIL) problem. In addition to the challenge of catastrophic forgetting, MLCIL encounters issues related to feature confusion, encompassing inter-session and intra-feature confusion. To address these problems, we propose a novel MLCIL approach called class-independent increment (CLIN). Specifically, in contrast to existing methods that extract image-level features, we propose a class-independent incremental network (CINet) to extract multiple class-level embeddings for multi-label samples. It learns and preserves the knowledge of different classes by constructing class-specific tokens. On this basis, we develop two novel loss functions, optimizing the learning of class-specific tokens and class-level embeddings, respectively. These losses aim to distinguish between new and old classes, further alleviating the problem of feature confusion. Extensive experiments on MS-COCO and PASCAL VOC datasets demonstrate the effectiveness of our method for improving recognition performance and mitigating forgetting on various MLCIL tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2503_00515
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Class-Independent Increment: An Efficient Approach for Multi-label Class-Incremental Learning
Ding, Chenhao
Dong, Songlin
Zhou, Zhengdong
Han, Jizhou
Wang, Qiang
He, Yuhang
Gong, Yihong
Computer Vision and Pattern Recognition
Current research on class-incremental learning primarily focuses on single-label classification tasks. However, real-world applications often involve multi-label scenarios, such as image retrieval and medical imaging. Therefore, this paper focuses on the challenging yet practical multi-label class-incremental learning (MLCIL) problem. In addition to the challenge of catastrophic forgetting, MLCIL encounters issues related to feature confusion, encompassing inter-session and intra-feature confusion. To address these problems, we propose a novel MLCIL approach called class-independent increment (CLIN). Specifically, in contrast to existing methods that extract image-level features, we propose a class-independent incremental network (CINet) to extract multiple class-level embeddings for multi-label samples. It learns and preserves the knowledge of different classes by constructing class-specific tokens. On this basis, we develop two novel loss functions, optimizing the learning of class-specific tokens and class-level embeddings, respectively. These losses aim to distinguish between new and old classes, further alleviating the problem of feature confusion. Extensive experiments on MS-COCO and PASCAL VOC datasets demonstrate the effectiveness of our method for improving recognition performance and mitigating forgetting on various MLCIL tasks.
title Class-Independent Increment: An Efficient Approach for Multi-label Class-Incremental Learning
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.00515