Better Matching, Less Forgetting: A Quality-Guided Matcher for Transformer-based Incremental Object Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wu, Qirui, Zhang, Shizhou, Cheng, De, Xing, Yinghui, Ran, Lingyan, Shi, Dahu, Wang, Peng
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908860107718656
author Wu, Qirui
Zhang, Shizhou
Cheng, De
Xing, Yinghui
Ran, Lingyan
Shi, Dahu
Wang, Peng
author_facet Wu, Qirui
Zhang, Shizhou
Cheng, De
Xing, Yinghui
Ran, Lingyan
Shi, Dahu
Wang, Peng
contents Incremental Object Detection (IOD) aims to continuously learn new object classes without forgetting previously learned ones. A persistent challenge is catastrophic forgetting, primarily attributed to background shift in conventional detectors. While pseudo-labeling mitigates this in dense detectors, we identify a novel, distinct source of forgetting specific to DETR-like architectures: background foregrounding. This arises from the exhaustiveness constraint of the Hungarian matcher, which forcibly assigns every ground truth target to one prediction, even when predictions primarily cover background regions (i.e., low IoU). This erroneous supervision compels the model to misclassify background features as specific foreground classes, disrupting learned representations and accelerating forgetting. To address this, we propose a Quality-guided Min-Cost Max-Flow (Q-MCMF) matcher. To avoid forced assignments, Q-MCMF builds a flow graph and prunes implausible matches based on geometric quality. It then optimizes for the final matching that minimizes cost and maximizes valid assignments. This strategy eliminates harmful supervision from background foregrounding while maximizing foreground learning signals. Extensive experiments on the COCO dataset under various incremental settings demonstrate that our method consistently outperforms existing state-of-the-art approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2603_01524
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Better Matching, Less Forgetting: A Quality-Guided Matcher for Transformer-based Incremental Object Detection
Wu, Qirui
Zhang, Shizhou
Cheng, De
Xing, Yinghui
Ran, Lingyan
Shi, Dahu
Wang, Peng
Computer Vision and Pattern Recognition
Incremental Object Detection (IOD) aims to continuously learn new object classes without forgetting previously learned ones. A persistent challenge is catastrophic forgetting, primarily attributed to background shift in conventional detectors. While pseudo-labeling mitigates this in dense detectors, we identify a novel, distinct source of forgetting specific to DETR-like architectures: background foregrounding. This arises from the exhaustiveness constraint of the Hungarian matcher, which forcibly assigns every ground truth target to one prediction, even when predictions primarily cover background regions (i.e., low IoU). This erroneous supervision compels the model to misclassify background features as specific foreground classes, disrupting learned representations and accelerating forgetting. To address this, we propose a Quality-guided Min-Cost Max-Flow (Q-MCMF) matcher. To avoid forced assignments, Q-MCMF builds a flow graph and prunes implausible matches based on geometric quality. It then optimizes for the final matching that minimizes cost and maximizes valid assignments. This strategy eliminates harmful supervision from background foregrounding while maximizing foreground learning signals. Extensive experiments on the COCO dataset under various incremental settings demonstrate that our method consistently outperforms existing state-of-the-art approaches.
title Better Matching, Less Forgetting: A Quality-Guided Matcher for Transformer-based Incremental Object Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.01524