HABIT: Chrono-Synergia Robust Progressive Learning Framework for Composed Image Retrieval

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Zixu, Hu, Yupeng, Chen, Zhiwei, Zhang, Shiqi, Huang, Qinlei, Fu, Zhiheng, Wei, Yinwei
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911607920001024
author Li, Zixu
Hu, Yupeng
Chen, Zhiwei
Zhang, Shiqi
Huang, Qinlei
Fu, Zhiheng
Wei, Yinwei
author_facet Li, Zixu
Hu, Yupeng
Chen, Zhiwei
Zhang, Shiqi
Huang, Qinlei
Fu, Zhiheng
Wei, Yinwei
contents Composed Image Retrieval (CIR) is a flexible image retrieval paradigm that enables users to accurately locate the target image through a multimodal query composed of a reference image and modification text. Although this task has demonstrated promising applications in personalized search and recommendation systems, it encounters a severe challenge in practical scenarios known as the Noise Triplet Correspondence (NTC) problem. This issue primarily arises from the high cost and subjectivity involved in annotating triplet data. To address this problem, we identify two central challenges: the precise estimation of composed semantic discrepancy and the insufficient progressive adaptation to modification discrepancy. To tackle these challenges, we propose a cHrono-synergiA roBust progressIve learning framework for composed image reTrieval (HABIT), which consists of two core modules. First, the Mutual Knowledge Estimation Module quantifies sample cleanliness by calculating the Transition Rate of mutual information between the composed feature and the target image, thereby effectively identifying clean samples that align with the intended modification semantics. Second, the Dual-consistency Progressive Learning Module introduces a collaborative mechanism between the historical and current models, simulating human habit formation to retain good habits and calibrate bad habits, ultimately enabling robust learning under the presence of NTC. Extensive experiments conducted on two standard CIR datasets demonstrate that HABIT significantly outperforms most methods under various noise ratios, exhibiting superior robustness and retrieval performance. Codes are available at https://github.com/Lee-zixu/HABIT
format Preprint
id arxiv_https___arxiv_org_abs_2604_18037
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle HABIT: Chrono-Synergia Robust Progressive Learning Framework for Composed Image Retrieval
Li, Zixu
Hu, Yupeng
Chen, Zhiwei
Zhang, Shiqi
Huang, Qinlei
Fu, Zhiheng
Wei, Yinwei
Computer Vision and Pattern Recognition
Composed Image Retrieval (CIR) is a flexible image retrieval paradigm that enables users to accurately locate the target image through a multimodal query composed of a reference image and modification text. Although this task has demonstrated promising applications in personalized search and recommendation systems, it encounters a severe challenge in practical scenarios known as the Noise Triplet Correspondence (NTC) problem. This issue primarily arises from the high cost and subjectivity involved in annotating triplet data. To address this problem, we identify two central challenges: the precise estimation of composed semantic discrepancy and the insufficient progressive adaptation to modification discrepancy. To tackle these challenges, we propose a cHrono-synergiA roBust progressIve learning framework for composed image reTrieval (HABIT), which consists of two core modules. First, the Mutual Knowledge Estimation Module quantifies sample cleanliness by calculating the Transition Rate of mutual information between the composed feature and the target image, thereby effectively identifying clean samples that align with the intended modification semantics. Second, the Dual-consistency Progressive Learning Module introduces a collaborative mechanism between the historical and current models, simulating human habit formation to retain good habits and calibrate bad habits, ultimately enabling robust learning under the presence of NTC. Extensive experiments conducted on two standard CIR datasets demonstrate that HABIT significantly outperforms most methods under various noise ratios, exhibiting superior robustness and retrieval performance. Codes are available at https://github.com/Lee-zixu/HABIT
title HABIT: Chrono-Synergia Robust Progressive Learning Framework for Composed Image Retrieval
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.18037