Semantic-aware Random Convolution and Source Matching for Domain Generalization in Medical Image Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Thaler, Franz, Urschler, Martin, Kozinski, Mateusz, Gsell, Matthias AF, Plank, Gernot, Stern, Darko
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918470404276224
author Thaler, Franz
Urschler, Martin
Kozinski, Mateusz
Gsell, Matthias AF
Plank, Gernot
Stern, Darko
author_facet Thaler, Franz
Urschler, Martin
Kozinski, Mateusz
Gsell, Matthias AF
Plank, Gernot
Stern, Darko
contents We tackle the challenging problem of single-source domain generalization (DG) for medical image segmentation, where we train a network on one domain (e.g., CT) and directly apply it to a different domain (e.g., MR) without adapting the model and without requiring images or annotations from the new domain during training. Our method diversifies the source domain through semantic-aware random convolution, where different regions of a source image are augmented differently at training-time, based on their annotation labels. At test-time, we complement the randomization of the training domain via mapping the intensity of target domain images, making them similar to source domain data. We perform a comprehensive evaluation on a variety of cross-modality and cross-center generalization settings for abdominal, whole-heart and prostate segmentation, where we outperform previous DG techniques in a vast majority of experiments. Additionally, we also investigate our method when training on whole-heart CT or MR data and testing on the diastolic and systolic phase of cine MR data captured with different scanner hardware. Overall, our evaluation shows that our method achieves new state-of-the-art performance in DG for medical image segmentation, even matching the performance of the in-domain baseline in several settings.
format Preprint
id arxiv_https___arxiv_org_abs_2512_01510
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Semantic-aware Random Convolution and Source Matching for Domain Generalization in Medical Image Segmentation
Thaler, Franz
Urschler, Martin
Kozinski, Mateusz
Gsell, Matthias AF
Plank, Gernot
Stern, Darko
Computer Vision and Pattern Recognition
Machine Learning
We tackle the challenging problem of single-source domain generalization (DG) for medical image segmentation, where we train a network on one domain (e.g., CT) and directly apply it to a different domain (e.g., MR) without adapting the model and without requiring images or annotations from the new domain during training. Our method diversifies the source domain through semantic-aware random convolution, where different regions of a source image are augmented differently at training-time, based on their annotation labels. At test-time, we complement the randomization of the training domain via mapping the intensity of target domain images, making them similar to source domain data. We perform a comprehensive evaluation on a variety of cross-modality and cross-center generalization settings for abdominal, whole-heart and prostate segmentation, where we outperform previous DG techniques in a vast majority of experiments. Additionally, we also investigate our method when training on whole-heart CT or MR data and testing on the diastolic and systolic phase of cine MR data captured with different scanner hardware. Overall, our evaluation shows that our method achieves new state-of-the-art performance in DG for medical image segmentation, even matching the performance of the in-domain baseline in several settings.
title Semantic-aware Random Convolution and Source Matching for Domain Generalization in Medical Image Segmentation
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2512.01510