S2S2: Semantic Stacking for Robust Semantic Segmentation in Medical Imaging

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Pan, Yimu, Zhang, Sitao, Gernand, Alison D., Goldstein, Jeffery A., Wang, James Z.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915069128867840
author Pan, Yimu
Zhang, Sitao
Gernand, Alison D.
Goldstein, Jeffery A.
Wang, James Z.
author_facet Pan, Yimu
Zhang, Sitao
Gernand, Alison D.
Goldstein, Jeffery A.
Wang, James Z.
contents Robustness and generalizability in medical image segmentation are often hindered by scarcity and limited diversity of training data, which stands in contrast to the variability encountered during inference. While conventional strategies -- such as domain-specific augmentation, specialized architectures, and tailored training procedures -- can alleviate these issues, they depend on the availability and reliability of domain knowledge. When such knowledge is unavailable, misleading, or improperly applied, performance may deteriorate. In response, we introduce a novel, domain-agnostic, add-on, and data-driven strategy inspired by image stacking in image denoising. Termed ``semantic stacking,'' our method estimates a denoised semantic representation that complements the conventional segmentation loss during training. This method does not depend on domain-specific assumptions, making it broadly applicable across diverse image modalities, model architectures, and augmentation techniques. Through extensive experiments, we validate the superiority of our approach in improving segmentation performance under diverse conditions. Code is available at https://github.com/ymp5078/Semantic-Stacking.
format Preprint
id arxiv_https___arxiv_org_abs_2412_13156
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle S2S2: Semantic Stacking for Robust Semantic Segmentation in Medical Imaging
Pan, Yimu
Zhang, Sitao
Gernand, Alison D.
Goldstein, Jeffery A.
Wang, James Z.
Computer Vision and Pattern Recognition
Robustness and generalizability in medical image segmentation are often hindered by scarcity and limited diversity of training data, which stands in contrast to the variability encountered during inference. While conventional strategies -- such as domain-specific augmentation, specialized architectures, and tailored training procedures -- can alleviate these issues, they depend on the availability and reliability of domain knowledge. When such knowledge is unavailable, misleading, or improperly applied, performance may deteriorate. In response, we introduce a novel, domain-agnostic, add-on, and data-driven strategy inspired by image stacking in image denoising. Termed ``semantic stacking,'' our method estimates a denoised semantic representation that complements the conventional segmentation loss during training. This method does not depend on domain-specific assumptions, making it broadly applicable across diverse image modalities, model architectures, and augmentation techniques. Through extensive experiments, we validate the superiority of our approach in improving segmentation performance under diverse conditions. Code is available at https://github.com/ymp5078/Semantic-Stacking.
title S2S2: Semantic Stacking for Robust Semantic Segmentation in Medical Imaging
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.13156