Latent Causal Modeling for 3D Brain MRI Counterfactuals

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Peng, Wei, Xia, Tian, Ribeiro, Fabio De Sousa, Bosschieter, Tomas, Adeli, Ehsan, Zhao, Qingyu, Glocker, Ben, Pohl, Kilian M.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908898331459584
author Peng, Wei
Xia, Tian
Ribeiro, Fabio De Sousa
Bosschieter, Tomas
Adeli, Ehsan
Zhao, Qingyu
Glocker, Ben
Pohl, Kilian M.
author_facet Peng, Wei
Xia, Tian
Ribeiro, Fabio De Sousa
Bosschieter, Tomas
Adeli, Ehsan
Zhao, Qingyu
Glocker, Ben
Pohl, Kilian M.
contents The number of samples in structural brain MRI studies is often too small to properly train deep learning models. Generative models show promise in addressing this issue by effectively learning the data distribution and generating high-fidelity MRI. However, they struggle to produce diverse, high-quality data outside the distribution defined by the training data. One way to address this issue is to use causal models developed for 3D volume counterfactuals. However, accurately modeling causality in high-dimensional spaces is challenging, so these models generally generate 3D brain MRIs of lower quality. To address these challenges, we propose a two-stage method that constructs a Structural Causal Model (SCM) within the latent space. In the first stage, we employ a VQ-VAE to learn a compact embedding of the MRI volume. Subsequently, we integrate our causal model into this latent space and execute a three-step counterfactual procedure using a closed-form Generalized Linear Model (GLM). Our experiments conducted on real-world high-resolution MRI data (1 mm) provided by the Alzheimer's Disease Neuroimaging Initiative (ADNI) and the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA) demonstrate that our method can generate high-quality 3D MRI counterfactuals.
format Preprint
id arxiv_https___arxiv_org_abs_2409_05585
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Latent Causal Modeling for 3D Brain MRI Counterfactuals
Peng, Wei
Xia, Tian
Ribeiro, Fabio De Sousa
Bosschieter, Tomas
Adeli, Ehsan
Zhao, Qingyu
Glocker, Ben
Pohl, Kilian M.
Computer Vision and Pattern Recognition
Artificial Intelligence
The number of samples in structural brain MRI studies is often too small to properly train deep learning models. Generative models show promise in addressing this issue by effectively learning the data distribution and generating high-fidelity MRI. However, they struggle to produce diverse, high-quality data outside the distribution defined by the training data. One way to address this issue is to use causal models developed for 3D volume counterfactuals. However, accurately modeling causality in high-dimensional spaces is challenging, so these models generally generate 3D brain MRIs of lower quality. To address these challenges, we propose a two-stage method that constructs a Structural Causal Model (SCM) within the latent space. In the first stage, we employ a VQ-VAE to learn a compact embedding of the MRI volume. Subsequently, we integrate our causal model into this latent space and execute a three-step counterfactual procedure using a closed-form Generalized Linear Model (GLM). Our experiments conducted on real-world high-resolution MRI data (1 mm) provided by the Alzheimer's Disease Neuroimaging Initiative (ADNI) and the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA) demonstrate that our method can generate high-quality 3D MRI counterfactuals.
title Latent Causal Modeling for 3D Brain MRI Counterfactuals
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2409.05585