WeatherRemover: All-in-one Adverse Weather Removal with Multi-scale Feature Map Compression

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Qu, Weikai, Liang, Sijun, Pan, Cheng, Yang, Zikuan, Zhou, Guanchi, Fu, Xianjun, Liu, Bo, Wang, Changmiao, Elazab, Ahmed
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911574586818560
author Qu, Weikai
Liang, Sijun
Pan, Cheng
Yang, Zikuan
Zhou, Guanchi
Fu, Xianjun
Liu, Bo
Wang, Changmiao
Elazab, Ahmed
author_facet Qu, Weikai
Liang, Sijun
Pan, Cheng
Yang, Zikuan
Zhou, Guanchi
Fu, Xianjun
Liu, Bo
Wang, Changmiao
Elazab, Ahmed
contents Photographs taken in adverse weather conditions often suffer from blurriness, occlusion, and low brightness due to interference from rain, snow, and fog. These issues can significantly hinder the performance of subsequent computer vision tasks, making the removal of weather effects a crucial step in image enhancement. Existing methods primarily target specific weather conditions, with only a few capable of handling multiple weather scenarios. However, mainstream approaches often overlook performance considerations, resulting in large parameter sizes, long inference times, and high memory costs. In this study, we introduce the WeatherRemover model, designed to enhance the restoration of images affected by various weather conditions while balancing performance. Our model adopts a UNet-like structure with a gating mechanism and a multi-scale pyramid vision Transformer. It employs channel-wise attention derived from convolutional neural networks to optimize feature extraction, while linear spatial reduction helps curtail the computational demands of attention. The gating mechanisms, strategically placed within the feed-forward and downsampling phases, refine the processing of information by selectively addressing redundancy and mitigating its influence on learning. This approach facilitates the adaptive selection of essential data, ensuring superior restoration and maximizing efficiency. Additionally, our lightweight model achieves an optimal balance between restoration quality, parameter efficiency, computational overhead, and memory usage, distinguishing it from other multi-weather models, thereby meeting practical application demands effectively. The source code is available at https://github.com/RICKand-MORTY/WeatherRemover.
format Preprint
id arxiv_https___arxiv_org_abs_2604_06623
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle WeatherRemover: All-in-one Adverse Weather Removal with Multi-scale Feature Map Compression
Qu, Weikai
Liang, Sijun
Pan, Cheng
Yang, Zikuan
Zhou, Guanchi
Fu, Xianjun
Liu, Bo
Wang, Changmiao
Elazab, Ahmed
Computer Vision and Pattern Recognition
Photographs taken in adverse weather conditions often suffer from blurriness, occlusion, and low brightness due to interference from rain, snow, and fog. These issues can significantly hinder the performance of subsequent computer vision tasks, making the removal of weather effects a crucial step in image enhancement. Existing methods primarily target specific weather conditions, with only a few capable of handling multiple weather scenarios. However, mainstream approaches often overlook performance considerations, resulting in large parameter sizes, long inference times, and high memory costs. In this study, we introduce the WeatherRemover model, designed to enhance the restoration of images affected by various weather conditions while balancing performance. Our model adopts a UNet-like structure with a gating mechanism and a multi-scale pyramid vision Transformer. It employs channel-wise attention derived from convolutional neural networks to optimize feature extraction, while linear spatial reduction helps curtail the computational demands of attention. The gating mechanisms, strategically placed within the feed-forward and downsampling phases, refine the processing of information by selectively addressing redundancy and mitigating its influence on learning. This approach facilitates the adaptive selection of essential data, ensuring superior restoration and maximizing efficiency. Additionally, our lightweight model achieves an optimal balance between restoration quality, parameter efficiency, computational overhead, and memory usage, distinguishing it from other multi-weather models, thereby meeting practical application demands effectively. The source code is available at https://github.com/RICKand-MORTY/WeatherRemover.
title WeatherRemover: All-in-one Adverse Weather Removal with Multi-scale Feature Map Compression
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.06623