UNISELF: A Unified Network with Instance Normalization and Self-Ensembled Lesion Fusion for Multiple Sclerosis Lesion Segmentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhang, Jinwei, Zuo, Lianrui, Dewey, Blake E., Remedios, Samuel W., Liu, Yihao, Hays, Savannah P., Pham, Dzung L., Mowry, Ellen M., Newsome, Scott D., Calabresi, Peter A., Carass, Aaron, Prince, Jerry L.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914284444844032
author Zhang, Jinwei
Zuo, Lianrui
Dewey, Blake E.
Remedios, Samuel W.
Liu, Yihao
Hays, Savannah P.
Pham, Dzung L.
Mowry, Ellen M.
Newsome, Scott D.
Calabresi, Peter A.
Carass, Aaron
Prince, Jerry L.
author_facet Zhang, Jinwei
Zuo, Lianrui
Dewey, Blake E.
Remedios, Samuel W.
Liu, Yihao
Hays, Savannah P.
Pham, Dzung L.
Mowry, Ellen M.
Newsome, Scott D.
Calabresi, Peter A.
Carass, Aaron
Prince, Jerry L.
contents Automated segmentation of multiple sclerosis (MS) lesions using multicontrast magnetic resonance (MR) images improves efficiency and reproducibility compared to manual delineation, with deep learning (DL) methods achieving state-of-the-art performance. However, these DL-based methods have yet to simultaneously optimize in-domain accuracy and out-of-domain generalization when trained on a single source with limited data, or their performance has been unsatisfactory. To fill this gap, we propose a method called UNISELF, which achieves high accuracy within a single training domain while demonstrating strong generalizability across multiple out-of-domain test datasets. UNISELF employs a novel test-time self-ensembled lesion fusion to improve segmentation accuracy, and leverages test-time instance normalization (TTIN) of latent features to address domain shifts and missing input contrasts. Trained on the ISBI 2015 longitudinal MS segmentation challenge training dataset, UNISELF ranks among the best-performing methods on the challenge test dataset. Additionally, UNISELF outperforms all benchmark methods trained on the same ISBI training data across diverse out-of-domain test datasets with domain shifts and missing contrasts, including the public MICCAI 2016 and UMCL datasets, as well as a private multisite dataset. These test datasets exhibit domain shifts and/or missing contrasts caused by variations in acquisition protocols, scanner types, and imaging artifacts arising from imperfect acquisition. Our code is available at https://github.com/uponacceptance.
format Preprint
id arxiv_https___arxiv_org_abs_2508_03982
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle UNISELF: A Unified Network with Instance Normalization and Self-Ensembled Lesion Fusion for Multiple Sclerosis Lesion Segmentation
Zhang, Jinwei
Zuo, Lianrui
Dewey, Blake E.
Remedios, Samuel W.
Liu, Yihao
Hays, Savannah P.
Pham, Dzung L.
Mowry, Ellen M.
Newsome, Scott D.
Calabresi, Peter A.
Carass, Aaron
Prince, Jerry L.
Image and Video Processing
Computer Vision and Pattern Recognition
Automated segmentation of multiple sclerosis (MS) lesions using multicontrast magnetic resonance (MR) images improves efficiency and reproducibility compared to manual delineation, with deep learning (DL) methods achieving state-of-the-art performance. However, these DL-based methods have yet to simultaneously optimize in-domain accuracy and out-of-domain generalization when trained on a single source with limited data, or their performance has been unsatisfactory. To fill this gap, we propose a method called UNISELF, which achieves high accuracy within a single training domain while demonstrating strong generalizability across multiple out-of-domain test datasets. UNISELF employs a novel test-time self-ensembled lesion fusion to improve segmentation accuracy, and leverages test-time instance normalization (TTIN) of latent features to address domain shifts and missing input contrasts. Trained on the ISBI 2015 longitudinal MS segmentation challenge training dataset, UNISELF ranks among the best-performing methods on the challenge test dataset. Additionally, UNISELF outperforms all benchmark methods trained on the same ISBI training data across diverse out-of-domain test datasets with domain shifts and missing contrasts, including the public MICCAI 2016 and UMCL datasets, as well as a private multisite dataset. These test datasets exhibit domain shifts and/or missing contrasts caused by variations in acquisition protocols, scanner types, and imaging artifacts arising from imperfect acquisition. Our code is available at https://github.com/uponacceptance.
title UNISELF: A Unified Network with Instance Normalization and Self-Ensembled Lesion Fusion for Multiple Sclerosis Lesion Segmentation
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.03982