An Empirical Study of Validating Synthetic Data for Text-Based Person Retrieval

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Cao, Min, Lu, Yuxin, Zeng, Ziyin, Yi, Dong, Wang, Jinqiao, Ye, Mang
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918450934317056
author Cao, Min
Lu, Yuxin
Zeng, Ziyin
Yi, Dong
Wang, Jinqiao
Ye, Mang
author_facet Cao, Min
Lu, Yuxin
Zeng, Ziyin
Yi, Dong
Wang, Jinqiao
Ye, Mang
contents Data plays a pivotal role in Text-Based Person Retrieval (TBPR) research. Mainstream research paradigm necessitates real-world person images with manual textual annotations for training models, posing privacy concerns and annotation burdens. Several pioneering efforts explore synthetic data generation, and yet still depend on real data as a foundation, inheriting the same limitations. The feasibility of purely synthetic TBPR data remains unexplored, and there is currently no systematic study on the effectiveness boundaries of synthetic data across various real-world scenarios. In this work, we present the first comprehensive empirical study of synthetic data for TBPR, with two key aspects. (1) We propose a unified data synthesis pipeline that can operate entirely without real person data. It combines an inter-class image generation module that produces diverse identity-centric images by means of an automatic prompt construction strategy, and an intra-class augmentation module that enhances identity variation through text-driven image editing. (2) Leveraging this pipeline and an automatic textual description generation, we explore the effectiveness of synthetic data in diverse scenarios through extensive experiments, to reveal its practical utility as either a standalone replacement or a complementary augmentation to real data.
format Preprint
id arxiv_https___arxiv_org_abs_2503_22171
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An Empirical Study of Validating Synthetic Data for Text-Based Person Retrieval
Cao, Min
Lu, Yuxin
Zeng, Ziyin
Yi, Dong
Wang, Jinqiao
Ye, Mang
Computer Vision and Pattern Recognition
Data plays a pivotal role in Text-Based Person Retrieval (TBPR) research. Mainstream research paradigm necessitates real-world person images with manual textual annotations for training models, posing privacy concerns and annotation burdens. Several pioneering efforts explore synthetic data generation, and yet still depend on real data as a foundation, inheriting the same limitations. The feasibility of purely synthetic TBPR data remains unexplored, and there is currently no systematic study on the effectiveness boundaries of synthetic data across various real-world scenarios. In this work, we present the first comprehensive empirical study of synthetic data for TBPR, with two key aspects. (1) We propose a unified data synthesis pipeline that can operate entirely without real person data. It combines an inter-class image generation module that produces diverse identity-centric images by means of an automatic prompt construction strategy, and an intra-class augmentation module that enhances identity variation through text-driven image editing. (2) Leveraging this pipeline and an automatic textual description generation, we explore the effectiveness of synthetic data in diverse scenarios through extensive experiments, to reveal its practical utility as either a standalone replacement or a complementary augmentation to real data.
title An Empirical Study of Validating Synthetic Data for Text-Based Person Retrieval
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.22171