MSA$^2$Net: Multi-scale Adaptive Attention-guided Network for Medical Image Segmentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Kolahi, Sina Ghorbani, Chaharsooghi, Seyed Kamal, Khatibi, Toktam, Bozorgpour, Afshin, Azad, Reza, Heidari, Moein, Hacihaliloglu, Ilker, Merhof, Dorit
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915011541073920
author Kolahi, Sina Ghorbani
Chaharsooghi, Seyed Kamal
Khatibi, Toktam
Bozorgpour, Afshin
Azad, Reza
Heidari, Moein
Hacihaliloglu, Ilker
Merhof, Dorit
author_facet Kolahi, Sina Ghorbani
Chaharsooghi, Seyed Kamal
Khatibi, Toktam
Bozorgpour, Afshin
Azad, Reza
Heidari, Moein
Hacihaliloglu, Ilker
Merhof, Dorit
contents Medical image segmentation involves identifying and separating object instances in a medical image to delineate various tissues and structures, a task complicated by the significant variations in size, shape, and density of these features. Convolutional neural networks (CNNs) have traditionally been used for this task but have limitations in capturing long-range dependencies. Transformers, equipped with self-attention mechanisms, aim to address this problem. However, in medical image segmentation it is beneficial to merge both local and global features to effectively integrate feature maps across various scales, capturing both detailed features and broader semantic elements for dealing with variations in structures. In this paper, we introduce MSA$^2$Net, a new deep segmentation framework featuring an expedient design of skip-connections. These connections facilitate feature fusion by dynamically weighting and combining coarse-grained encoder features with fine-grained decoder feature maps. Specifically, we propose a Multi-Scale Adaptive Spatial Attention Gate (MASAG), which dynamically adjusts the receptive field (Local and Global contextual information) to ensure that spatially relevant features are selectively highlighted while minimizing background distractions. Extensive evaluations involving dermatology, and radiological datasets demonstrate that our MSA$^2$Net outperforms state-of-the-art (SOTA) works or matches their performance. The source code is publicly available at https://github.com/xmindflow/MSA-2Net.
format Preprint
id arxiv_https___arxiv_org_abs_2407_21640
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MSA$^2$Net: Multi-scale Adaptive Attention-guided Network for Medical Image Segmentation
Kolahi, Sina Ghorbani
Chaharsooghi, Seyed Kamal
Khatibi, Toktam
Bozorgpour, Afshin
Azad, Reza
Heidari, Moein
Hacihaliloglu, Ilker
Merhof, Dorit
Image and Video Processing
Computer Vision and Pattern Recognition
Medical image segmentation involves identifying and separating object instances in a medical image to delineate various tissues and structures, a task complicated by the significant variations in size, shape, and density of these features. Convolutional neural networks (CNNs) have traditionally been used for this task but have limitations in capturing long-range dependencies. Transformers, equipped with self-attention mechanisms, aim to address this problem. However, in medical image segmentation it is beneficial to merge both local and global features to effectively integrate feature maps across various scales, capturing both detailed features and broader semantic elements for dealing with variations in structures. In this paper, we introduce MSA$^2$Net, a new deep segmentation framework featuring an expedient design of skip-connections. These connections facilitate feature fusion by dynamically weighting and combining coarse-grained encoder features with fine-grained decoder feature maps. Specifically, we propose a Multi-Scale Adaptive Spatial Attention Gate (MASAG), which dynamically adjusts the receptive field (Local and Global contextual information) to ensure that spatially relevant features are selectively highlighted while minimizing background distractions. Extensive evaluations involving dermatology, and radiological datasets demonstrate that our MSA$^2$Net outperforms state-of-the-art (SOTA) works or matches their performance. The source code is publicly available at https://github.com/xmindflow/MSA-2Net.
title MSA$^2$Net: Multi-scale Adaptive Attention-guided Network for Medical Image Segmentation
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.21640