HINT: Composed Image Retrieval with Dual-path Compositional Contextualized Network

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Mingyu, Li, Zixu, Chen, Zhiwei, Fu, Zhiheng, Zhu, Xiaowei, Nie, Jiajia, Wei, Yinwei, Hu, Yupeng
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914426642235392
author Zhang, Mingyu
Li, Zixu
Chen, Zhiwei
Fu, Zhiheng
Zhu, Xiaowei
Nie, Jiajia
Wei, Yinwei
Hu, Yupeng
author_facet Zhang, Mingyu
Li, Zixu
Chen, Zhiwei
Fu, Zhiheng
Zhu, Xiaowei
Nie, Jiajia
Wei, Yinwei
Hu, Yupeng
contents Composed Image Retrieval (CIR) is a challenging image retrieval paradigm. It aims to retrieve target images from large-scale image databases that are consistent with the modification semantics, based on a multimodal query composed of a reference image and modification text. Although existing methods have made significant progress in cross-modal alignment and feature fusion, a key flaw remains: the neglect of contextual information in discriminating matching samples. However, addressing this limitation is not an easy task due to two challenges: 1) implicit dependencies and 2) the lack of a differential amplification mechanism. To address these challenges, we propose a dual-patH composItional coNtextualized neTwork (HINT), which can perform contextualized encoding and amplify the similarity differences between matching and non-matching samples, thus improving the upper performance of CIR models in complex scenarios. Our HINT model achieves optimal performance on all metrics across two CIR benchmark datasets, demonstrating the superiority of our HINT model. Codes are available at https://github.com/zh-mingyu/HINT.
format Preprint
id arxiv_https___arxiv_org_abs_2603_26341
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle HINT: Composed Image Retrieval with Dual-path Compositional Contextualized Network
Zhang, Mingyu
Li, Zixu
Chen, Zhiwei
Fu, Zhiheng
Zhu, Xiaowei
Nie, Jiajia
Wei, Yinwei
Hu, Yupeng
Computer Vision and Pattern Recognition
Composed Image Retrieval (CIR) is a challenging image retrieval paradigm. It aims to retrieve target images from large-scale image databases that are consistent with the modification semantics, based on a multimodal query composed of a reference image and modification text. Although existing methods have made significant progress in cross-modal alignment and feature fusion, a key flaw remains: the neglect of contextual information in discriminating matching samples. However, addressing this limitation is not an easy task due to two challenges: 1) implicit dependencies and 2) the lack of a differential amplification mechanism. To address these challenges, we propose a dual-patH composItional coNtextualized neTwork (HINT), which can perform contextualized encoding and amplify the similarity differences between matching and non-matching samples, thus improving the upper performance of CIR models in complex scenarios. Our HINT model achieves optimal performance on all metrics across two CIR benchmark datasets, demonstrating the superiority of our HINT model. Codes are available at https://github.com/zh-mingyu/HINT.
title HINT: Composed Image Retrieval with Dual-path Compositional Contextualized Network
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.26341