MvKSR: Multi-view Knowledge-guided Scene Recovery for Hazy and Rainy Degradation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yang, Dong, Xu, Wenyu, Gao, Yuan, Lu, Yuxu, Zhang, Jingming, Guo, Yu
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929203596754944
author Yang, Dong
Xu, Wenyu
Gao, Yuan
Lu, Yuxu
Zhang, Jingming
Guo, Yu
author_facet Yang, Dong
Xu, Wenyu
Gao, Yuan
Lu, Yuxu
Zhang, Jingming
Guo, Yu
contents High-quality imaging is crucial for ensuring safety supervision and intelligent deployment in fields like transportation and industry. It enables precise and detailed monitoring of operations, facilitating timely detection of potential hazards and efficient management. However, adverse weather conditions, such as atmospheric haziness and precipitation, can have a significant impact on image quality. When the atmosphere contains dense haze or water droplets, the incident light scatters, leading to degraded captured images. This degradation is evident in the form of image blur and reduced contrast, increasing the likelihood of incorrect assessments and interpretations by intelligent imaging systems (IIS). To address the challenge of restoring degraded images in hazy and rainy conditions, this paper proposes a novel multi-view knowledge-guided scene recovery network (termed MvKSR). Specifically, guided filtering is performed on the degraded image to separate high/low-frequency components. Subsequently, an en-decoder-based multi-view feature coarse extraction module (MCE) is used to coarsely extract features from different views of the degraded image. The multi-view feature fine fusion module (MFF) will learn and infer the restoration of degraded images through mixed supervision under different views. Additionally, we suggest an atrous residual block to handle global restoration and local repair in hazy/rainy/mixed scenes. Extensive experimental results demonstrate that MvKSR outperforms other state-of-the-art methods in terms of efficiency and stability for restoring degraded scenarios in IIS.
format Preprint
id arxiv_https___arxiv_org_abs_2401_03800
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MvKSR: Multi-view Knowledge-guided Scene Recovery for Hazy and Rainy Degradation
Yang, Dong
Xu, Wenyu
Gao, Yuan
Lu, Yuxu
Zhang, Jingming
Guo, Yu
Computer Vision and Pattern Recognition
Image and Video Processing
High-quality imaging is crucial for ensuring safety supervision and intelligent deployment in fields like transportation and industry. It enables precise and detailed monitoring of operations, facilitating timely detection of potential hazards and efficient management. However, adverse weather conditions, such as atmospheric haziness and precipitation, can have a significant impact on image quality. When the atmosphere contains dense haze or water droplets, the incident light scatters, leading to degraded captured images. This degradation is evident in the form of image blur and reduced contrast, increasing the likelihood of incorrect assessments and interpretations by intelligent imaging systems (IIS). To address the challenge of restoring degraded images in hazy and rainy conditions, this paper proposes a novel multi-view knowledge-guided scene recovery network (termed MvKSR). Specifically, guided filtering is performed on the degraded image to separate high/low-frequency components. Subsequently, an en-decoder-based multi-view feature coarse extraction module (MCE) is used to coarsely extract features from different views of the degraded image. The multi-view feature fine fusion module (MFF) will learn and infer the restoration of degraded images through mixed supervision under different views. Additionally, we suggest an atrous residual block to handle global restoration and local repair in hazy/rainy/mixed scenes. Extensive experimental results demonstrate that MvKSR outperforms other state-of-the-art methods in terms of efficiency and stability for restoring degraded scenarios in IIS.
title MvKSR: Multi-view Knowledge-guided Scene Recovery for Hazy and Rainy Degradation
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2401.03800