Saved in:
Bibliographic Details
Main Authors: Yao, Yi, Hsu, Chan-Feng, Lin, Jhe-Hao, Xie, Hongxia, Lin, Terence, Huang, Yi-Ning, Shuai, Hong-Han, Cheng, Wen-Huang
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.12579
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • In spite of recent advancements in text-to-image generation, limitations persist in handling complex and imaginative prompts due to the restricted diversity and complexity of training data. This work explores how diffusion models can generate images from prompts requiring artistic creativity or specialized knowledge. We introduce the Realistic-Fantasy Benchmark (RFBench), a novel evaluation framework blending realistic and fantastical scenarios. To address these challenges, we propose the Realistic-Fantasy Network (RFNet), a training-free approach integrating diffusion models with LLMs. Extensive human evaluations and GPT-based compositional assessments demonstrate our approach's superiority over state-of-the-art methods. Our code and dataset is available at https://leo81005.github.io/Reality-and-Fantasy/.