CGI: Identifying Conditional Generative Models with Example Images

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhou, Zhi, Tan, Hao-Zhe, Song, Peng-Xiao, Guo, Lan-Zhe
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912610395357184
author Zhou, Zhi
Tan, Hao-Zhe
Song, Peng-Xiao
Guo, Lan-Zhe
author_facet Zhou, Zhi
Tan, Hao-Zhe
Song, Peng-Xiao
Guo, Lan-Zhe
contents Generative models have achieved remarkable performance recently, and thus model hubs have emerged. Existing model hubs typically assume basic text matching is sufficient to search for models. However, in reality, due to different abstractions and the large number of models in model hubs, it is not easy for users to review model descriptions and example images, choosing which model best meets their needs. Therefore, it is necessary to describe model functionality wisely so that future users can efficiently search for the most suitable model for their needs. Efforts to address this issue remain limited. In this paper, we propose Conditional Generative Model Identification (CGI), which aims to provide an effective way to identify the most suitable model using user-provided example images rather than requiring users to manually review a large number of models with example images. To address this problem, we propose the PromptBased Model Identification (PMI) , which can adequately describe model functionality and precisely match requirements with specifications. To evaluate PMI approach and promote related research, we provide a benchmark comprising 65 models and 9100 identification tasks. Extensive experimental and human evaluation results demonstrate that PMI is effective. For instance, 92% of models are correctly identified with significantly better FID scores when four example images are provided.
format Preprint
id arxiv_https___arxiv_org_abs_2501_13991
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CGI: Identifying Conditional Generative Models with Example Images
Zhou, Zhi
Tan, Hao-Zhe
Song, Peng-Xiao
Guo, Lan-Zhe
Computer Vision and Pattern Recognition
Artificial Intelligence
Generative models have achieved remarkable performance recently, and thus model hubs have emerged. Existing model hubs typically assume basic text matching is sufficient to search for models. However, in reality, due to different abstractions and the large number of models in model hubs, it is not easy for users to review model descriptions and example images, choosing which model best meets their needs. Therefore, it is necessary to describe model functionality wisely so that future users can efficiently search for the most suitable model for their needs. Efforts to address this issue remain limited. In this paper, we propose Conditional Generative Model Identification (CGI), which aims to provide an effective way to identify the most suitable model using user-provided example images rather than requiring users to manually review a large number of models with example images. To address this problem, we propose the PromptBased Model Identification (PMI) , which can adequately describe model functionality and precisely match requirements with specifications. To evaluate PMI approach and promote related research, we provide a benchmark comprising 65 models and 9100 identification tasks. Extensive experimental and human evaluation results demonstrate that PMI is effective. For instance, 92% of models are correctly identified with significantly better FID scores when four example images are provided.
title CGI: Identifying Conditional Generative Models with Example Images
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2501.13991