CLIP-DQA: Blindly Evaluating Dehazed Images from Global and Local Perspectives Using CLIP

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zeng, Yirui, Fu, Jun, Amirpour, Hadi, Wang, Huasheng, Yue, Guanghui, Liu, Hantao, Chen, Ying, Zhou, Wei
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913676427001856
author Zeng, Yirui
Fu, Jun
Amirpour, Hadi
Wang, Huasheng
Yue, Guanghui
Liu, Hantao
Chen, Ying
Zhou, Wei
author_facet Zeng, Yirui
Fu, Jun
Amirpour, Hadi
Wang, Huasheng
Yue, Guanghui
Liu, Hantao
Chen, Ying
Zhou, Wei
contents Blind dehazed image quality assessment (BDQA), which aims to accurately predict the visual quality of dehazed images without any reference information, is essential for the evaluation, comparison, and optimization of image dehazing algorithms. Existing learning-based BDQA methods have achieved remarkable success, while the small scale of DQA datasets limits their performance. To address this issue, in this paper, we propose to adapt Contrastive Language-Image Pre-Training (CLIP), pre-trained on large-scale image-text pairs, to the BDQA task. Specifically, inspired by the fact that the human visual system understands images based on hierarchical features, we take global and local information of the dehazed image as the input of CLIP. To accurately map the input hierarchical information of dehazed images into the quality score, we tune both the vision branch and language branch of CLIP with prompt learning. Experimental results on two authentic DQA datasets demonstrate that our proposed approach, named CLIP-DQA, achieves more accurate quality predictions over existing BDQA methods. The code is available at https://github.com/JunFu1995/CLIP-DQA.
format Preprint
id arxiv_https___arxiv_org_abs_2502_01707
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CLIP-DQA: Blindly Evaluating Dehazed Images from Global and Local Perspectives Using CLIP
Zeng, Yirui
Fu, Jun
Amirpour, Hadi
Wang, Huasheng
Yue, Guanghui
Liu, Hantao
Chen, Ying
Zhou, Wei
Computer Vision and Pattern Recognition
Artificial Intelligence
Blind dehazed image quality assessment (BDQA), which aims to accurately predict the visual quality of dehazed images without any reference information, is essential for the evaluation, comparison, and optimization of image dehazing algorithms. Existing learning-based BDQA methods have achieved remarkable success, while the small scale of DQA datasets limits their performance. To address this issue, in this paper, we propose to adapt Contrastive Language-Image Pre-Training (CLIP), pre-trained on large-scale image-text pairs, to the BDQA task. Specifically, inspired by the fact that the human visual system understands images based on hierarchical features, we take global and local information of the dehazed image as the input of CLIP. To accurately map the input hierarchical information of dehazed images into the quality score, we tune both the vision branch and language branch of CLIP with prompt learning. Experimental results on two authentic DQA datasets demonstrate that our proposed approach, named CLIP-DQA, achieves more accurate quality predictions over existing BDQA methods. The code is available at https://github.com/JunFu1995/CLIP-DQA.
title CLIP-DQA: Blindly Evaluating Dehazed Images from Global and Local Perspectives Using CLIP
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2502.01707