Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2312.05476 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917603416473600 |
|---|---|
| author | Chen, Zijian Sun, Wei Wu, Haoning Zhang, Zicheng Jia, Jun Ji, Zhongpeng Sun, Fengyu Jui, Shangling Min, Xiongkuo Zhai, Guangtao Zhang, Wenjun |
| author_facet | Chen, Zijian Sun, Wei Wu, Haoning Zhang, Zicheng Jia, Jun Ji, Zhongpeng Sun, Fengyu Jui, Shangling Min, Xiongkuo Zhai, Guangtao Zhang, Wenjun |
| contents | The proliferation of Artificial Intelligence-Generated Images (AGIs) has greatly expanded the Image Naturalness Assessment (INA) problem. Different from early definitions that mainly focus on tone-mapped images with limited distortions (e.g., exposure, contrast, and color reproduction), INA on AI-generated images is especially challenging as it has more diverse contents and could be affected by factors from multiple perspectives, including low-level technical distortions and high-level rationality distortions. In this paper, we take the first step to benchmark and assess the visual naturalness of AI-generated images. First, we construct the AI-Generated Image Naturalness (AGIN) database by conducting a large-scale subjective study to collect human opinions on the overall naturalness as well as perceptions from technical and rationality perspectives. AGIN verifies that naturalness is universally and disparately affected by technical and rationality distortions. Second, we propose the Joint Objective Image Naturalness evaluaTor (JOINT), to automatically predict the naturalness of AGIs that aligns human ratings. Specifically, JOINT imitates human reasoning in naturalness evaluation by jointly learning both technical and rationality features. We demonstrate that JOINT significantly outperforms baselines for providing more subjectively consistent results on naturalness assessment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_05476 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Exploring the Naturalness of AI-Generated Images Chen, Zijian Sun, Wei Wu, Haoning Zhang, Zicheng Jia, Jun Ji, Zhongpeng Sun, Fengyu Jui, Shangling Min, Xiongkuo Zhai, Guangtao Zhang, Wenjun Computer Vision and Pattern Recognition The proliferation of Artificial Intelligence-Generated Images (AGIs) has greatly expanded the Image Naturalness Assessment (INA) problem. Different from early definitions that mainly focus on tone-mapped images with limited distortions (e.g., exposure, contrast, and color reproduction), INA on AI-generated images is especially challenging as it has more diverse contents and could be affected by factors from multiple perspectives, including low-level technical distortions and high-level rationality distortions. In this paper, we take the first step to benchmark and assess the visual naturalness of AI-generated images. First, we construct the AI-Generated Image Naturalness (AGIN) database by conducting a large-scale subjective study to collect human opinions on the overall naturalness as well as perceptions from technical and rationality perspectives. AGIN verifies that naturalness is universally and disparately affected by technical and rationality distortions. Second, we propose the Joint Objective Image Naturalness evaluaTor (JOINT), to automatically predict the naturalness of AGIs that aligns human ratings. Specifically, JOINT imitates human reasoning in naturalness evaluation by jointly learning both technical and rationality features. We demonstrate that JOINT significantly outperforms baselines for providing more subjectively consistent results on naturalness assessment. |
| title | Exploring the Naturalness of AI-Generated Images |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2312.05476 |