Saved in:
Bibliographic Details
Main Authors: Ma, Weiwei, Yu, Xiaobing, Qiu, Peijie, Yang, Jin, Xiao, Pan, Zhao, Xiaoqi, Liu, Xiaofeng, Miyazaki, Tomo, Omachi, Shinichiro, Huang, Yongsong
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.14605
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911388909174784
author Ma, Weiwei
Yu, Xiaobing
Qiu, Peijie
Yang, Jin
Xiao, Pan
Zhao, Xiaoqi
Liu, Xiaofeng
Miyazaki, Tomo
Omachi, Shinichiro
Huang, Yongsong
author_facet Ma, Weiwei
Yu, Xiaobing
Qiu, Peijie
Yang, Jin
Xiao, Pan
Zhao, Xiaoqi
Liu, Xiaofeng
Miyazaki, Tomo
Omachi, Shinichiro
Huang, Yongsong
contents In clinical practice, medical segmentation datasets are often limited and heterogeneous, with variations in modalities, protocols, and anatomical targets across institutions. Existing deep learning models struggle to jointly learn from such diverse data, often sacrificing either generalization or domain-specific knowledge. To overcome these challenges, we propose a joint training method called Universal Harmonization (U-Harmony), which can be integrated into deep learning-based architectures with a domain-gated head, enabling a single segmentation model to learn from heterogeneous datasets simultaneously. By integrating U-Harmony, our approach sequentially normalizes and then denormalizes feature distributions to mitigate domain-specific variations while preserving original dataset-specific knowledge. More appealingly, our framework also supports universal modality adaptation, allowing the seamless learning of new imaging modalities and anatomical classes. Extensive experiments on cross-institutional brain lesion datasets demonstrate the effectiveness of our approach, establishing a new benchmark for robust and adaptable 3D medical image segmentation models in real-world clinical settings.
format Preprint
id arxiv_https___arxiv_org_abs_2601_14605
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle U-Harmony: Enhancing Joint Training for Segmentation Models with Universal Harmonization
Ma, Weiwei
Yu, Xiaobing
Qiu, Peijie
Yang, Jin
Xiao, Pan
Zhao, Xiaoqi
Liu, Xiaofeng
Miyazaki, Tomo
Omachi, Shinichiro
Huang, Yongsong
Computer Vision and Pattern Recognition
Machine Learning
In clinical practice, medical segmentation datasets are often limited and heterogeneous, with variations in modalities, protocols, and anatomical targets across institutions. Existing deep learning models struggle to jointly learn from such diverse data, often sacrificing either generalization or domain-specific knowledge. To overcome these challenges, we propose a joint training method called Universal Harmonization (U-Harmony), which can be integrated into deep learning-based architectures with a domain-gated head, enabling a single segmentation model to learn from heterogeneous datasets simultaneously. By integrating U-Harmony, our approach sequentially normalizes and then denormalizes feature distributions to mitigate domain-specific variations while preserving original dataset-specific knowledge. More appealingly, our framework also supports universal modality adaptation, allowing the seamless learning of new imaging modalities and anatomical classes. Extensive experiments on cross-institutional brain lesion datasets demonstrate the effectiveness of our approach, establishing a new benchmark for robust and adaptable 3D medical image segmentation models in real-world clinical settings.
title U-Harmony: Enhancing Joint Training for Segmentation Models with Universal Harmonization
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2601.14605