CARNet: Collaborative Adversarial Resilience for Robust Underwater Image Enhancement and Perception

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Zengxi, Shi, Zeru, Jiang, Zhiying, Liu, Jinyuan
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912275313459200
author Zhang, Zengxi
Shi, Zeru
Jiang, Zhiying
Liu, Jinyuan
author_facet Zhang, Zengxi
Shi, Zeru
Jiang, Zhiying
Liu, Jinyuan
contents Due to the uneven absorption of different light wavelengths in aquatic environments, underwater images suffer from low visibility and clear color deviations. With the advancement of autonomous underwater vehicles, extensive research has been conducted on learning-based underwater enhancement algorithms. These works can generate visually pleasing enhanced images and mitigate the adverse effects of degraded images on subsequent perception tasks. However, learning-based methods are susceptible to the inherent fragility of adversarial attacks, causing significant disruption in enhanced results. In this work, we introduce a collaborative adversarial resilience network, dubbed CARNet, for underwater image enhancement and subsequent detection tasks. Concretely, we first introduce an invertible network with strong perturbation-perceptual abilities to isolate attacks from underwater images, preventing interference with visual quality enhancement and perceptual tasks. Furthermore, an attack pattern discriminator is introduced to adaptively identify and eliminate various types of attacks. Additionally, we propose a bilevel attack optimization strategy to heighten the robustness of the network against different types of attacks under the collaborative adversarial training of vision-driven and perception-driven attacks. Extensive experiments demonstrate that the proposed method outputs visually appealing enhancement images and performs an average 6.71% higher detection mAP than state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2309_01102
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle CARNet: Collaborative Adversarial Resilience for Robust Underwater Image Enhancement and Perception
Zhang, Zengxi
Shi, Zeru
Jiang, Zhiying
Liu, Jinyuan
Computer Vision and Pattern Recognition
Due to the uneven absorption of different light wavelengths in aquatic environments, underwater images suffer from low visibility and clear color deviations. With the advancement of autonomous underwater vehicles, extensive research has been conducted on learning-based underwater enhancement algorithms. These works can generate visually pleasing enhanced images and mitigate the adverse effects of degraded images on subsequent perception tasks. However, learning-based methods are susceptible to the inherent fragility of adversarial attacks, causing significant disruption in enhanced results. In this work, we introduce a collaborative adversarial resilience network, dubbed CARNet, for underwater image enhancement and subsequent detection tasks. Concretely, we first introduce an invertible network with strong perturbation-perceptual abilities to isolate attacks from underwater images, preventing interference with visual quality enhancement and perceptual tasks. Furthermore, an attack pattern discriminator is introduced to adaptively identify and eliminate various types of attacks. Additionally, we propose a bilevel attack optimization strategy to heighten the robustness of the network against different types of attacks under the collaborative adversarial training of vision-driven and perception-driven attacks. Extensive experiments demonstrate that the proposed method outputs visually appealing enhancement images and performs an average 6.71% higher detection mAP than state-of-the-art methods.
title CARNet: Collaborative Adversarial Resilience for Robust Underwater Image Enhancement and Perception
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2309.01102