Deform-Mamba Network for MRI Super-Resolution

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ji, Zexin, Zou, Beiji, Kui, Xiaoyan, Vera, Pierre, Ruan, Su
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913421139640320
author Ji, Zexin
Zou, Beiji
Kui, Xiaoyan
Vera, Pierre
Ruan, Su
author_facet Ji, Zexin
Zou, Beiji
Kui, Xiaoyan
Vera, Pierre
Ruan, Su
contents In this paper, we propose a new architecture, called Deform-Mamba, for MR image super-resolution. Unlike conventional CNN or Transformer-based super-resolution approaches which encounter challenges related to the local respective field or heavy computational cost, our approach aims to effectively explore the local and global information of images. Specifically, we develop a Deform-Mamba encoder which is composed of two branches, modulated deform block and vision Mamba block. We also design a multi-view context module in the bottleneck layer to explore the multi-view contextual content. Thanks to the extracted features of the encoder, which include content-adaptive local and efficient global information, the vision Mamba decoder finally generates high-quality MR images. Moreover, we introduce a contrastive edge loss to promote the reconstruction of edge and contrast related content. Quantitative and qualitative experimental results indicate that our approach on IXI and fastMRI datasets achieves competitive performance.
format Preprint
id arxiv_https___arxiv_org_abs_2407_05969
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deform-Mamba Network for MRI Super-Resolution
Ji, Zexin
Zou, Beiji
Kui, Xiaoyan
Vera, Pierre
Ruan, Su
Computer Vision and Pattern Recognition
In this paper, we propose a new architecture, called Deform-Mamba, for MR image super-resolution. Unlike conventional CNN or Transformer-based super-resolution approaches which encounter challenges related to the local respective field or heavy computational cost, our approach aims to effectively explore the local and global information of images. Specifically, we develop a Deform-Mamba encoder which is composed of two branches, modulated deform block and vision Mamba block. We also design a multi-view context module in the bottleneck layer to explore the multi-view contextual content. Thanks to the extracted features of the encoder, which include content-adaptive local and efficient global information, the vision Mamba decoder finally generates high-quality MR images. Moreover, we introduce a contrastive edge loss to promote the reconstruction of edge and contrast related content. Quantitative and qualitative experimental results indicate that our approach on IXI and fastMRI datasets achieves competitive performance.
title Deform-Mamba Network for MRI Super-Resolution
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.05969