PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908860071018496 |
|---|---|
| author | Xu, Tianyi Shan, Rong Wu, Junjie Huang, Jiadeng Wang, Teng Zhu, Jiachen Chen, Wenteng Tu, Minxin Dou, Quantao Wang, Zhaoxiang Zhang, Changwang Zhang, Weinan Wang, Jun Lin, Jianghao |
| author_facet | Xu, Tianyi Shan, Rong Wu, Junjie Huang, Jiadeng Wang, Teng Zhu, Jiachen Chen, Wenteng Tu, Minxin Dou, Quantao Wang, Zhaoxiang Zhang, Changwang Zhang, Weinan Wang, Jun Lin, Jianghao |
| contents | Personal photo albums are not merely collections of static images but living, ecological archives defined by temporal continuity, social entanglement, and rich metadata, which makes the personalized photo retrieval non-trivial. However, existing retrieval benchmarks rely heavily on context-isolated web snapshots, failing to capture the multi-source reasoning required to resolve authentic, intent-driven user queries. To bridge this gap, we introduce PhotoBench, the first benchmark constructed from authentic, personal albums. It is designed to shift the paradigm from visual matching to personalized multi-source intent-driven reasoning. Based on a rigorous multi-source profiling framework, which integrates visual semantics, spatial-temporal metadata, social identity, and temporal events for each image, we synthesize complex intent-driven queries rooted in users' life trajectories. Extensive evaluation on PhotoBench exposes two critical limitations: the modality gap, where unified embedding models collapse on non-visual constraints, and the source fusion paradox, where agentic systems perform poor tool orchestration. These findings indicate that the next frontier in personal multimodal retrieval lies beyond unified embeddings, necessitating robust agentic reasoning systems capable of precise constraint satisfaction and multi-source fusion. Our PhotoBench is available. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_01493 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval Xu, Tianyi Shan, Rong Wu, Junjie Huang, Jiadeng Wang, Teng Zhu, Jiachen Chen, Wenteng Tu, Minxin Dou, Quantao Wang, Zhaoxiang Zhang, Changwang Zhang, Weinan Wang, Jun Lin, Jianghao Information Retrieval Artificial Intelligence Computer Vision and Pattern Recognition Multimedia Personal photo albums are not merely collections of static images but living, ecological archives defined by temporal continuity, social entanglement, and rich metadata, which makes the personalized photo retrieval non-trivial. However, existing retrieval benchmarks rely heavily on context-isolated web snapshots, failing to capture the multi-source reasoning required to resolve authentic, intent-driven user queries. To bridge this gap, we introduce PhotoBench, the first benchmark constructed from authentic, personal albums. It is designed to shift the paradigm from visual matching to personalized multi-source intent-driven reasoning. Based on a rigorous multi-source profiling framework, which integrates visual semantics, spatial-temporal metadata, social identity, and temporal events for each image, we synthesize complex intent-driven queries rooted in users' life trajectories. Extensive evaluation on PhotoBench exposes two critical limitations: the modality gap, where unified embedding models collapse on non-visual constraints, and the source fusion paradox, where agentic systems perform poor tool orchestration. These findings indicate that the next frontier in personal multimodal retrieval lies beyond unified embeddings, necessitating robust agentic reasoning systems capable of precise constraint satisfaction and multi-source fusion. Our PhotoBench is available. |
| title | PhotoBench: Beyond Visual Matching Towards Personalized Intent-Driven Photo Retrieval |
| topic | Information Retrieval Artificial Intelligence Computer Vision and Pattern Recognition Multimedia |
| url | https://arxiv.org/abs/2603.01493 |