DyCoRM: Dynamic Criterion-Aware Reward Modeling for Text-to-Image Generation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Qian, Jiaying, Jia, Ziheng, Zhang, Qian, Zhang, Zicheng, Guo, Jiayi, Zhang, Junqi, Zhai, Guangtao, Min, Xiongkuo
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916044847710208
author Qian, Jiaying
Jia, Ziheng
Zhang, Qian
Zhang, Zicheng
Guo, Jiayi
Zhang, Junqi
Zhai, Guangtao
Min, Xiongkuo
author_facet Qian, Jiaying
Jia, Ziheng
Zhang, Qian
Zhang, Zicheng
Guo, Jiayi
Zhang, Junqi
Zhai, Guangtao
Min, Xiongkuo
contents With the continued advancement of text-to-image (T2I) generation, producing high-quality images is becoming increasingly attainable; consequently, user demands are shifting toward images that better satisfy their specific requirements. As reward models play an increasingly important role in assessing whether generated images align with user preference, this trend introduces an important challenge for reward modeling: rather than relying solely on static and general evaluation dimensions, reward models should account for the task-relevant and fine-grained criteria through which users assess whether generated images meet their specific requirements. To address this challenge, we propose DyCoRM, a dynamic, criterion-aware reward model that grounds task-relevant criteria and performs criterion-aware preference comparison. To support this setting, we construct DyCoDataset-20K, which provides dynamic criteria together with criterion-level annotations, and further derive DyCoBench-1K, a benchmark for systematically evaluating reward models under dynamic criteria. We further introduce DyCoPick, which applies criterion-aware reward modeling to selecting T2I images. Our contributions establish the first reward modeling framework for dynamic and fine-grained evaluation and practical application in T2I generation.
format Preprint
id arxiv_https___arxiv_org_abs_2605_25876
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle DyCoRM: Dynamic Criterion-Aware Reward Modeling for Text-to-Image Generation
Qian, Jiaying
Jia, Ziheng
Zhang, Qian
Zhang, Zicheng
Guo, Jiayi
Zhang, Junqi
Zhai, Guangtao
Min, Xiongkuo
Computer Vision and Pattern Recognition
With the continued advancement of text-to-image (T2I) generation, producing high-quality images is becoming increasingly attainable; consequently, user demands are shifting toward images that better satisfy their specific requirements. As reward models play an increasingly important role in assessing whether generated images align with user preference, this trend introduces an important challenge for reward modeling: rather than relying solely on static and general evaluation dimensions, reward models should account for the task-relevant and fine-grained criteria through which users assess whether generated images meet their specific requirements. To address this challenge, we propose DyCoRM, a dynamic, criterion-aware reward model that grounds task-relevant criteria and performs criterion-aware preference comparison. To support this setting, we construct DyCoDataset-20K, which provides dynamic criteria together with criterion-level annotations, and further derive DyCoBench-1K, a benchmark for systematically evaluating reward models under dynamic criteria. We further introduce DyCoPick, which applies criterion-aware reward modeling to selecting T2I images. Our contributions establish the first reward modeling framework for dynamic and fine-grained evaluation and practical application in T2I generation.
title DyCoRM: Dynamic Criterion-Aware Reward Modeling for Text-to-Image Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2605.25876