M$^{2}$SNet: Multi-scale in Multi-scale Subtraction Network for Medical Image Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhao, Xiaoqi, Jia, Hongpeng, Pang, Youwei, Lv, Long, Tian, Feng, Zhang, Lihe, Sun, Weibing, Lu, Huchuan
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913021794713600
author Zhao, Xiaoqi
Jia, Hongpeng
Pang, Youwei
Lv, Long
Tian, Feng
Zhang, Lihe
Sun, Weibing
Lu, Huchuan
author_facet Zhao, Xiaoqi
Jia, Hongpeng
Pang, Youwei
Lv, Long
Tian, Feng
Zhang, Lihe
Sun, Weibing
Lu, Huchuan
contents Accurate medical image segmentation is critical for early medical diagnosis. Most existing methods are based on U-shape structure and use element-wise addition or concatenation to fuse different level features progressively in decoder. However, both the two operations easily generate plenty of redundant information, which will weaken the complementarity between different level features, resulting in inaccurate localization and blurred edges of lesions. To address this challenge, we propose a general multi-scale in multi-scale subtraction network (M$^{2}$SNet) to finish diverse segmentation from medical image. Specifically, we first design a basic subtraction unit (SU) to produce the difference features between adjacent levels in encoder. Next, we expand the single-scale SU to the intra-layer multi-scale SU, which can provide the decoder with both pixel-level and structure-level difference information. Then, we pyramidally equip the multi-scale SUs at different levels with varying receptive fields, thereby achieving the inter-layer multi-scale feature aggregation and obtaining rich multi-scale difference information. In addition, we build a training-free network ``LossNet'' to comprehensively supervise the task-aware features from bottom layer to top layer, which drives our multi-scale subtraction network to capture the detailed and structural cues simultaneously. Without bells and whistles, our method performs favorably against most state-of-the-art methods under different evaluation metrics on eleven datasets of four different medical image segmentation tasks of diverse image modalities, including color colonoscopy imaging, ultrasound imaging, computed tomography (CT), and optical coherence tomography (OCT). The source code can be available at https://github.com/Xiaoqi-Zhao-DLUT/MSNet.
format Preprint
id arxiv_https___arxiv_org_abs_2303_10894
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle M$^{2}$SNet: Multi-scale in Multi-scale Subtraction Network for Medical Image Segmentation
Zhao, Xiaoqi
Jia, Hongpeng
Pang, Youwei
Lv, Long
Tian, Feng
Zhang, Lihe
Sun, Weibing
Lu, Huchuan
Computer Vision and Pattern Recognition
Accurate medical image segmentation is critical for early medical diagnosis. Most existing methods are based on U-shape structure and use element-wise addition or concatenation to fuse different level features progressively in decoder. However, both the two operations easily generate plenty of redundant information, which will weaken the complementarity between different level features, resulting in inaccurate localization and blurred edges of lesions. To address this challenge, we propose a general multi-scale in multi-scale subtraction network (M$^{2}$SNet) to finish diverse segmentation from medical image. Specifically, we first design a basic subtraction unit (SU) to produce the difference features between adjacent levels in encoder. Next, we expand the single-scale SU to the intra-layer multi-scale SU, which can provide the decoder with both pixel-level and structure-level difference information. Then, we pyramidally equip the multi-scale SUs at different levels with varying receptive fields, thereby achieving the inter-layer multi-scale feature aggregation and obtaining rich multi-scale difference information. In addition, we build a training-free network ``LossNet'' to comprehensively supervise the task-aware features from bottom layer to top layer, which drives our multi-scale subtraction network to capture the detailed and structural cues simultaneously. Without bells and whistles, our method performs favorably against most state-of-the-art methods under different evaluation metrics on eleven datasets of four different medical image segmentation tasks of diverse image modalities, including color colonoscopy imaging, ultrasound imaging, computed tomography (CT), and optical coherence tomography (OCT). The source code can be available at https://github.com/Xiaoqi-Zhao-DLUT/MSNet.
title M$^{2}$SNet: Multi-scale in Multi-scale Subtraction Network for Medical Image Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2303.10894