Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusion

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wu, Mengqi, Yu, Minhui, Jing, Shuaiming, Yap, Pew-Thian, Zhang, Zhengwu, Liu, Mingxia
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914915377217536
author Wu, Mengqi
Yu, Minhui
Jing, Shuaiming
Yap, Pew-Thian
Zhang, Zhengwu
Liu, Mingxia
author_facet Wu, Mengqi
Yu, Minhui
Jing, Shuaiming
Yap, Pew-Thian
Zhang, Zhengwu
Liu, Mingxia
contents Multi-site structural MRI is increasingly used in neuroimaging studies to diversify subject cohorts. However, combining MR images acquired from various sites/centers may introduce site-related non-biological variations. Retrospective image harmonization helps address this issue, but current methods usually perform harmonization on pre-extracted hand-crafted radiomic features, limiting downstream applicability. Several image-level approaches focus on 2D slices, disregarding inherent volumetric information, leading to suboptimal outcomes. To this end, we propose a novel 3D MRI Harmonization framework through Conditional Latent Diffusion (HCLD) by explicitly considering image style and brain anatomy. It comprises a generalizable 3D autoencoder that encodes and decodes MRIs through a 4D latent space, and a conditional latent diffusion model that learns the latent distribution and generates harmonized MRIs with anatomical information from source MRIs while conditioned on target image style. This enables efficient volume-level MRI harmonization through latent style translation, without requiring paired images from target and source domains during training. The HCLD is trained and evaluated on 4,158 T1-weighted brain MRIs from three datasets in three tasks, assessing its ability to remove site-related variations while retaining essential biological features. Qualitative and quantitative experiments suggest the effectiveness of HCLD over several state-of-the-arts
format Preprint
id arxiv_https___arxiv_org_abs_2408_09315
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusion
Wu, Mengqi
Yu, Minhui
Jing, Shuaiming
Yap, Pew-Thian
Zhang, Zhengwu
Liu, Mingxia
Image and Video Processing
Computer Vision and Pattern Recognition
Multi-site structural MRI is increasingly used in neuroimaging studies to diversify subject cohorts. However, combining MR images acquired from various sites/centers may introduce site-related non-biological variations. Retrospective image harmonization helps address this issue, but current methods usually perform harmonization on pre-extracted hand-crafted radiomic features, limiting downstream applicability. Several image-level approaches focus on 2D slices, disregarding inherent volumetric information, leading to suboptimal outcomes. To this end, we propose a novel 3D MRI Harmonization framework through Conditional Latent Diffusion (HCLD) by explicitly considering image style and brain anatomy. It comprises a generalizable 3D autoencoder that encodes and decodes MRIs through a 4D latent space, and a conditional latent diffusion model that learns the latent distribution and generates harmonized MRIs with anatomical information from source MRIs while conditioned on target image style. This enables efficient volume-level MRI harmonization through latent style translation, without requiring paired images from target and source domains during training. The HCLD is trained and evaluated on 4,158 T1-weighted brain MRIs from three datasets in three tasks, assessing its ability to remove site-related variations while retaining essential biological features. Qualitative and quantitative experiments suggest the effectiveness of HCLD over several state-of-the-arts
title Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusion
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.09315