A Two-Stage Adverse Weather Semantic Segmentation Method for WeatherProof Challenge CVPR 2024 Workshop UG2+

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Jianzhao, Wei, Yanyan, Hu, Dehua, Zhang, Yilin, Tang, Shengeng, Li, Kun, Zhang, Zhao
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916319748685824
author Wang, Jianzhao
Wei, Yanyan
Hu, Dehua
Zhang, Yilin
Tang, Shengeng
Li, Kun
Zhang, Zhao
author_facet Wang, Jianzhao
Wei, Yanyan
Hu, Dehua
Zhang, Yilin
Tang, Shengeng
Li, Kun
Zhang, Zhao
contents This technical report presents our team's solution for the WeatherProof Dataset Challenge: Semantic Segmentation in Adverse Weather at CVPR'24 UG2+. We propose a two-stage deep learning framework for this task. In the first stage, we preprocess the provided dataset by concatenating images into video sequences. Subsequently, we leverage a low-rank video deraining method to generate high-fidelity pseudo ground truths. These pseudo ground truths offer superior alignment compared to the original ground truths, facilitating model convergence during training. In the second stage, we employ the InternImage network to train for the semantic segmentation task using the generated pseudo ground truths. Notably, our meticulously designed framework demonstrates robustness to degraded data captured under adverse weather conditions. In the challenge, our solution achieved a competitive score of 0.43 on the Mean Intersection over Union (mIoU) metric, securing a respectable rank of 4th.
format Preprint
id arxiv_https___arxiv_org_abs_2406_05513
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Two-Stage Adverse Weather Semantic Segmentation Method for WeatherProof Challenge CVPR 2024 Workshop UG2+
Wang, Jianzhao
Wei, Yanyan
Hu, Dehua
Zhang, Yilin
Tang, Shengeng
Li, Kun
Zhang, Zhao
Computer Vision and Pattern Recognition
This technical report presents our team's solution for the WeatherProof Dataset Challenge: Semantic Segmentation in Adverse Weather at CVPR'24 UG2+. We propose a two-stage deep learning framework for this task. In the first stage, we preprocess the provided dataset by concatenating images into video sequences. Subsequently, we leverage a low-rank video deraining method to generate high-fidelity pseudo ground truths. These pseudo ground truths offer superior alignment compared to the original ground truths, facilitating model convergence during training. In the second stage, we employ the InternImage network to train for the semantic segmentation task using the generated pseudo ground truths. Notably, our meticulously designed framework demonstrates robustness to degraded data captured under adverse weather conditions. In the challenge, our solution achieved a competitive score of 0.43 on the Mean Intersection over Union (mIoU) metric, securing a respectable rank of 4th.
title A Two-Stage Adverse Weather Semantic Segmentation Method for WeatherProof Challenge CVPR 2024 Workshop UG2+
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.05513