Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Grouping

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lai, Guannan, Li, Yujie, Wang, Xiangkun, Zhang, Junbo, Li, Tianrui, Yang, Xin
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912279310630912
author Lai, Guannan
Li, Yujie
Wang, Xiangkun
Zhang, Junbo
Li, Tianrui
Yang, Xin
author_facet Lai, Guannan
Li, Yujie
Wang, Xiangkun
Zhang, Junbo
Li, Tianrui
Yang, Xin
contents Class Incremental Learning (CIL) aims to enable models to learn new classes sequentially while retaining knowledge of previous ones. Although current methods have alleviated catastrophic forgetting (CF), recent studies highlight that the performance of CIL models is highly sensitive to the order of class arrival, particularly when sequentially introduced classes exhibit high inter-class similarity. To address this critical yet understudied challenge of class order sensitivity, we first extend existing CIL frameworks through theoretical analysis, proving that grouping classes with lower pairwise similarity during incremental phases significantly improves model robustness to order variations. Building on this insight, we propose Graph-Driven Dynamic Similarity Grouping (GDDSG), a novel method that employs graph coloring algorithms to dynamically partition classes into similarity-constrained groups. Each group trains an isolated CIL sub-model and constructs meta-features for class group identification. Experimental results demonstrate that our method effectively addresses the issue of class order sensitivity while achieving optimal performance in both model accuracy and anti-forgetting capability. Our code is available at https://github.com/AIGNLAI/GDDSG.
format Preprint
id arxiv_https___arxiv_org_abs_2502_20032
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Grouping
Lai, Guannan
Li, Yujie
Wang, Xiangkun
Zhang, Junbo
Li, Tianrui
Yang, Xin
Machine Learning
Artificial Intelligence
68T05, 68Q25, 68U05
I.2.6; I.2.10
Class Incremental Learning (CIL) aims to enable models to learn new classes sequentially while retaining knowledge of previous ones. Although current methods have alleviated catastrophic forgetting (CF), recent studies highlight that the performance of CIL models is highly sensitive to the order of class arrival, particularly when sequentially introduced classes exhibit high inter-class similarity. To address this critical yet understudied challenge of class order sensitivity, we first extend existing CIL frameworks through theoretical analysis, proving that grouping classes with lower pairwise similarity during incremental phases significantly improves model robustness to order variations. Building on this insight, we propose Graph-Driven Dynamic Similarity Grouping (GDDSG), a novel method that employs graph coloring algorithms to dynamically partition classes into similarity-constrained groups. Each group trains an isolated CIL sub-model and constructs meta-features for class group identification. Experimental results demonstrate that our method effectively addresses the issue of class order sensitivity while achieving optimal performance in both model accuracy and anti-forgetting capability. Our code is available at https://github.com/AIGNLAI/GDDSG.
title Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Grouping
topic Machine Learning
Artificial Intelligence
68T05, 68Q25, 68U05
I.2.6; I.2.10
url https://arxiv.org/abs/2502.20032