CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908767299305472 |
|---|---|
| author | Tong, Chengzhuo Chang, Mingkun Zhang, Shenglong Wang, Yuran Liang, Cheng Zhao, Zhizheng An, Ruichuan Zeng, Bohan Shi, Yang Dai, Yifan Zhao, Ziming Li, Guanbin Wan, Pengfei Zhang, Yuanxing Zhang, Wentao |
| author_facet | Tong, Chengzhuo Chang, Mingkun Zhang, Shenglong Wang, Yuran Liang, Cheng Zhao, Zhizheng An, Ruichuan Zeng, Bohan Shi, Yang Dai, Yifan Zhao, Ziming Li, Guanbin Wan, Pengfei Zhang, Yuanxing Zhang, Wentao |
| contents | Recent video generation models have revealed the emergence of Chain-of-Frame (CoF) reasoning, enabling frame-by-frame visual inference. With this capability, video models have been successfully applied to various visual tasks (e.g., maze solving, visual puzzles). However, their potential to enhance text-to-image (T2I) generation remains largely unexplored due to the absence of a clearly defined visual reasoning starting point and interpretable intermediate states in the T2I generation process. To bridge this gap, we propose CoF-T2I, a model that integrates CoF reasoning into T2I generation via progressive visual refinement, where intermediate frames act as explicit reasoning steps and the final frame is taken as output. To establish such an explicit generation process, we curate CoF-Evol-Instruct, a dataset of CoF trajectories that model the generation process from semantics to aesthetics. To further improve quality and avoid motion artifacts, we enable independent encoding operation for each frame. Experiments show that CoF-T2I significantly outperforms the base video model and achieves competitive performance on challenging benchmarks, reaching 0.86 on GenEval and 7.468 on Imagine-Bench. These results indicate the substantial promise of video models for advancing high-quality text-to-image generation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_10061 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation Tong, Chengzhuo Chang, Mingkun Zhang, Shenglong Wang, Yuran Liang, Cheng Zhao, Zhizheng An, Ruichuan Zeng, Bohan Shi, Yang Dai, Yifan Zhao, Ziming Li, Guanbin Wan, Pengfei Zhang, Yuanxing Zhang, Wentao Computer Vision and Pattern Recognition Artificial Intelligence Recent video generation models have revealed the emergence of Chain-of-Frame (CoF) reasoning, enabling frame-by-frame visual inference. With this capability, video models have been successfully applied to various visual tasks (e.g., maze solving, visual puzzles). However, their potential to enhance text-to-image (T2I) generation remains largely unexplored due to the absence of a clearly defined visual reasoning starting point and interpretable intermediate states in the T2I generation process. To bridge this gap, we propose CoF-T2I, a model that integrates CoF reasoning into T2I generation via progressive visual refinement, where intermediate frames act as explicit reasoning steps and the final frame is taken as output. To establish such an explicit generation process, we curate CoF-Evol-Instruct, a dataset of CoF trajectories that model the generation process from semantics to aesthetics. To further improve quality and avoid motion artifacts, we enable independent encoding operation for each frame. Experiments show that CoF-T2I significantly outperforms the base video model and achieves competitive performance on challenging benchmarks, reaching 0.86 on GenEval and 7.468 on Imagine-Bench. These results indicate the substantial promise of video models for advancing high-quality text-to-image generation. |
| title | CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2601.10061 |