VL-UR: Vision-Language-guided Universal Restoration of Images Degraded by Adverse Weather Conditions

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Liu, Ziyan, Lu, Yuxu, Yu, Huashan, yang, Dong
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917982478794752
author Liu, Ziyan
Lu, Yuxu
Yu, Huashan
yang, Dong
author_facet Liu, Ziyan
Lu, Yuxu
Yu, Huashan
yang, Dong
contents Image restoration is critical for improving the quality of degraded images, which is vital for applications like autonomous driving, security surveillance, and digital content enhancement. However, existing methods are often tailored to specific degradation scenarios, limiting their adaptability to the diverse and complex challenges in real-world environments. Moreover, real-world degradations are typically non-uniform, highlighting the need for adaptive and intelligent solutions. To address these issues, we propose a novel vision-language-guided universal restoration (VL-UR) framework. VL-UR leverages a zero-shot contrastive language-image pre-training (CLIP) model to enhance image restoration by integrating visual and semantic information. A scene classifier is introduced to adapt CLIP, generating high-quality language embeddings aligned with degraded images while predicting degraded types for complex scenarios. Extensive experiments across eleven diverse degradation settings demonstrate VL-UR's state-of-the-art performance, robustness, and adaptability. This positions VL-UR as a transformative solution for modern image restoration challenges in dynamic, real-world environments.
format Preprint
id arxiv_https___arxiv_org_abs_2504_08219
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle VL-UR: Vision-Language-guided Universal Restoration of Images Degraded by Adverse Weather Conditions
Liu, Ziyan
Lu, Yuxu
Yu, Huashan
yang, Dong
Computer Vision and Pattern Recognition
Image restoration is critical for improving the quality of degraded images, which is vital for applications like autonomous driving, security surveillance, and digital content enhancement. However, existing methods are often tailored to specific degradation scenarios, limiting their adaptability to the diverse and complex challenges in real-world environments. Moreover, real-world degradations are typically non-uniform, highlighting the need for adaptive and intelligent solutions. To address these issues, we propose a novel vision-language-guided universal restoration (VL-UR) framework. VL-UR leverages a zero-shot contrastive language-image pre-training (CLIP) model to enhance image restoration by integrating visual and semantic information. A scene classifier is introduced to adapt CLIP, generating high-quality language embeddings aligned with degraded images while predicting degraded types for complex scenarios. Extensive experiments across eleven diverse degradation settings demonstrate VL-UR's state-of-the-art performance, robustness, and adaptability. This positions VL-UR as a transformative solution for modern image restoration challenges in dynamic, real-world environments.
title VL-UR: Vision-Language-guided Universal Restoration of Images Degraded by Adverse Weather Conditions
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.08219