HarmonyIQA: Pioneering Benchmark and Model for Image Harmonization Quality Assessment
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909446795427840 |
|---|---|
| author | Xu, Zitong Duan, Huiyu Ma, Guangji Yang, Liu Wang, Jiarui Wu, Qingbo Min, Xiongkuo Zhai, Guangtao Callet, Patrick Le |
| author_facet | Xu, Zitong Duan, Huiyu Ma, Guangji Yang, Liu Wang, Jiarui Wu, Qingbo Min, Xiongkuo Zhai, Guangtao Callet, Patrick Le |
| contents | Image composition involves extracting a foreground object from one image and pasting it into another image through Image harmonization algorithms (IHAs), which aim to adjust the appearance of the foreground object to better match the background. Existing image quality assessment (IQA) methods may fail to align with human visual preference on image harmonization due to the insensitivity to minor color or light inconsistency. To address the issue and facilitate the advancement of IHAs, we introduce the first Image Quality Assessment Database for image Harmony evaluation (HarmonyIQAD), which consists of 1,350 harmonized images generated by 9 different IHAs, and the corresponding human visual preference scores. Based on this database, we propose a Harmony Image Quality Assessment (HarmonyIQA), to predict human visual preference for harmonized images. Extensive experiments show that HarmonyIQA achieves state-of-the-art performance on human visual preference evaluation for harmonized images, and also achieves competing results on traditional IQA tasks. Furthermore, cross-dataset evaluation also shows that HarmonyIQA exhibits better generalization ability than self-supervised learning-based IQA methods. Both HarmonyIQAD and HarmonyIQA will be made publicly available upon paper publication. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_01116 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | HarmonyIQA: Pioneering Benchmark and Model for Image Harmonization Quality Assessment Xu, Zitong Duan, Huiyu Ma, Guangji Yang, Liu Wang, Jiarui Wu, Qingbo Min, Xiongkuo Zhai, Guangtao Callet, Patrick Le Computer Vision and Pattern Recognition Multimedia Image composition involves extracting a foreground object from one image and pasting it into another image through Image harmonization algorithms (IHAs), which aim to adjust the appearance of the foreground object to better match the background. Existing image quality assessment (IQA) methods may fail to align with human visual preference on image harmonization due to the insensitivity to minor color or light inconsistency. To address the issue and facilitate the advancement of IHAs, we introduce the first Image Quality Assessment Database for image Harmony evaluation (HarmonyIQAD), which consists of 1,350 harmonized images generated by 9 different IHAs, and the corresponding human visual preference scores. Based on this database, we propose a Harmony Image Quality Assessment (HarmonyIQA), to predict human visual preference for harmonized images. Extensive experiments show that HarmonyIQA achieves state-of-the-art performance on human visual preference evaluation for harmonized images, and also achieves competing results on traditional IQA tasks. Furthermore, cross-dataset evaluation also shows that HarmonyIQA exhibits better generalization ability than self-supervised learning-based IQA methods. Both HarmonyIQAD and HarmonyIQA will be made publicly available upon paper publication. |
| title | HarmonyIQA: Pioneering Benchmark and Model for Image Harmonization Quality Assessment |
| topic | Computer Vision and Pattern Recognition Multimedia |
| url | https://arxiv.org/abs/2501.01116 |