WaterMamba: Visual State Space Model for Underwater Image Enhancement

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Guan, Meisheng, Xu, Haiyong, Jiang, Gangyi, Yu, Mei, Chen, Yeyao, Luo, Ting, Song, Yang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911876643815424
author Guan, Meisheng
Xu, Haiyong
Jiang, Gangyi
Yu, Mei
Chen, Yeyao
Luo, Ting
Song, Yang
author_facet Guan, Meisheng
Xu, Haiyong
Jiang, Gangyi
Yu, Mei
Chen, Yeyao
Luo, Ting
Song, Yang
contents Underwater imaging often suffers from low quality due to factors affecting light propagation and absorption in water. To improve image quality, some underwater image enhancement (UIE) methods based on convolutional neural networks (CNN) and Transformer have been proposed. However, CNN-based UIE methods are limited in modeling long-range dependencies, and Transformer-based methods involve a large number of parameters and complex self-attention mechanisms, posing efficiency challenges. Considering computational complexity and severe underwater image degradation, a state space model (SSM) with linear computational complexity for UIE, named WaterMamba, is proposed. We propose spatial-channel omnidirectional selective scan (SCOSS) blocks comprising spatial-channel coordinate omnidirectional selective scan (SCCOSS) modules and a multi-scale feedforward network (MSFFN). The SCOSS block models pixel and channel information flow, addressing dependencies. The MSFFN facilitates information flow adjustment and promotes synchronized operations within SCCOSS modules. Extensive experiments showcase WaterMamba's cutting-edge performance with reduced parameters and computational resources, outperforming state-of-the-art methods on various datasets, validating its effectiveness and generalizability. The code will be released on GitHub after acceptance.
format Preprint
id arxiv_https___arxiv_org_abs_2405_08419
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle WaterMamba: Visual State Space Model for Underwater Image Enhancement
Guan, Meisheng
Xu, Haiyong
Jiang, Gangyi
Yu, Mei
Chen, Yeyao
Luo, Ting
Song, Yang
Computer Vision and Pattern Recognition
Underwater imaging often suffers from low quality due to factors affecting light propagation and absorption in water. To improve image quality, some underwater image enhancement (UIE) methods based on convolutional neural networks (CNN) and Transformer have been proposed. However, CNN-based UIE methods are limited in modeling long-range dependencies, and Transformer-based methods involve a large number of parameters and complex self-attention mechanisms, posing efficiency challenges. Considering computational complexity and severe underwater image degradation, a state space model (SSM) with linear computational complexity for UIE, named WaterMamba, is proposed. We propose spatial-channel omnidirectional selective scan (SCOSS) blocks comprising spatial-channel coordinate omnidirectional selective scan (SCCOSS) modules and a multi-scale feedforward network (MSFFN). The SCOSS block models pixel and channel information flow, addressing dependencies. The MSFFN facilitates information flow adjustment and promotes synchronized operations within SCCOSS modules. Extensive experiments showcase WaterMamba's cutting-edge performance with reduced parameters and computational resources, outperforming state-of-the-art methods on various datasets, validating its effectiveness and generalizability. The code will be released on GitHub after acceptance.
title WaterMamba: Visual State Space Model for Underwater Image Enhancement
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.08419