Multi-modal MRI Translation via Evidential Regression and Distribution Calibration

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liu, Jiyao, Gao, Shangqi, Li, Yuxin, Liu, Lihao, Gao, Xin, Xing, Zhaohu, Ning, Junzhi, Su, Yanzhou, Zhang, Xiao-Yong, He, Junjun, Xu, Ningsheng, Zhuang, Xiahai
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918022634012672
author Liu, Jiyao
Gao, Shangqi
Li, Yuxin
Liu, Lihao
Gao, Xin
Xing, Zhaohu
Ning, Junzhi
Su, Yanzhou
Zhang, Xiao-Yong
He, Junjun
Xu, Ningsheng
Zhuang, Xiahai
author_facet Liu, Jiyao
Gao, Shangqi
Li, Yuxin
Liu, Lihao
Gao, Xin
Xing, Zhaohu
Ning, Junzhi
Su, Yanzhou
Zhang, Xiao-Yong
He, Junjun
Xu, Ningsheng
Zhuang, Xiahai
contents Multi-modal Magnetic Resonance Imaging (MRI) translation leverages information from source MRI sequences to generate target modalities, enabling comprehensive diagnosis while overcoming the limitations of acquiring all sequences. While existing deep-learning-based multi-modal MRI translation methods have shown promising potential, they still face two key challenges: 1) lack of reliable uncertainty quantification for synthesized images, and 2) limited robustness when deployed across different medical centers. To address these challenges, we propose a novel framework that reformulates multi-modal MRI translation as a multi-modal evidential regression problem with distribution calibration. Our approach incorporates two key components: 1) an evidential regression module that estimates uncertainties from different source modalities and an explicit distribution mixture strategy for transparent multi-modal fusion, and 2) a distribution calibration mechanism that adapts to source-target mapping shifts to ensure consistent performance across different medical centers. Extensive experiments on three datasets from the BraTS2023 challenge demonstrate that our framework achieves superior performance and robustness across domains.
format Preprint
id arxiv_https___arxiv_org_abs_2407_07372
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multi-modal MRI Translation via Evidential Regression and Distribution Calibration
Liu, Jiyao
Gao, Shangqi
Li, Yuxin
Liu, Lihao
Gao, Xin
Xing, Zhaohu
Ning, Junzhi
Su, Yanzhou
Zhang, Xiao-Yong
He, Junjun
Xu, Ningsheng
Zhuang, Xiahai
Image and Video Processing
Computer Vision and Pattern Recognition
Multi-modal Magnetic Resonance Imaging (MRI) translation leverages information from source MRI sequences to generate target modalities, enabling comprehensive diagnosis while overcoming the limitations of acquiring all sequences. While existing deep-learning-based multi-modal MRI translation methods have shown promising potential, they still face two key challenges: 1) lack of reliable uncertainty quantification for synthesized images, and 2) limited robustness when deployed across different medical centers. To address these challenges, we propose a novel framework that reformulates multi-modal MRI translation as a multi-modal evidential regression problem with distribution calibration. Our approach incorporates two key components: 1) an evidential regression module that estimates uncertainties from different source modalities and an explicit distribution mixture strategy for transparent multi-modal fusion, and 2) a distribution calibration mechanism that adapts to source-target mapping shifts to ensure consistent performance across different medical centers. Extensive experiments on three datasets from the BraTS2023 challenge demonstrate that our framework achieves superior performance and robustness across domains.
title Multi-modal MRI Translation via Evidential Regression and Distribution Calibration
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.07372