Synergistic PET/CT Reconstruction Using a Joint Generative Model

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pinton, Noel Jeffrey, Bousse, Alexandre, Wang, Zhihan, Cheze-Le-Rest, Catherine, Maxim, Voichita, Comtat, Claude, Sureau, Florent, Visvikis, Dimitris
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929588845674496
author Pinton, Noel Jeffrey
Bousse, Alexandre
Wang, Zhihan
Cheze-Le-Rest, Catherine
Maxim, Voichita
Comtat, Claude
Sureau, Florent
Visvikis, Dimitris
author_facet Pinton, Noel Jeffrey
Bousse, Alexandre
Wang, Zhihan
Cheze-Le-Rest, Catherine
Maxim, Voichita
Comtat, Claude
Sureau, Florent
Visvikis, Dimitris
contents We propose in this work a framework for synergistic positron emission tomography (PET)/computed tomography (CT) reconstruction using a joint generative model as a penalty. We use a synergistic penalty function that promotes PET/CT pairs that are likely to occur together. The synergistic penalty function is based on a generative model, namely $β$-variational autoencoder ($β$-VAE). The model generates a PET/CT image pair from the same latent variable which contains the information that is shared between the two modalities. This sharing of inter-modal information can help reduce noise during reconstruction. Our result shows that our method was able to utilize the information between two modalities. The proposed method was able to outperform individually reconstructed images of PET (i.e., by maximum likelihood expectation maximization (MLEM)) and CT (i.e., by weighted least squares (WLS)) in terms of peak signal-to-noise ratio (PSNR). Future work will focus on optimizing the parameters of the $β$-VAE network and further exploration of other generative network models.
format Preprint
id arxiv_https___arxiv_org_abs_2411_07339
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Synergistic PET/CT Reconstruction Using a Joint Generative Model
Pinton, Noel Jeffrey
Bousse, Alexandre
Wang, Zhihan
Cheze-Le-Rest, Catherine
Maxim, Voichita
Comtat, Claude
Sureau, Florent
Visvikis, Dimitris
Medical Physics
We propose in this work a framework for synergistic positron emission tomography (PET)/computed tomography (CT) reconstruction using a joint generative model as a penalty. We use a synergistic penalty function that promotes PET/CT pairs that are likely to occur together. The synergistic penalty function is based on a generative model, namely $β$-variational autoencoder ($β$-VAE). The model generates a PET/CT image pair from the same latent variable which contains the information that is shared between the two modalities. This sharing of inter-modal information can help reduce noise during reconstruction. Our result shows that our method was able to utilize the information between two modalities. The proposed method was able to outperform individually reconstructed images of PET (i.e., by maximum likelihood expectation maximization (MLEM)) and CT (i.e., by weighted least squares (WLS)) in terms of peak signal-to-noise ratio (PSNR). Future work will focus on optimizing the parameters of the $β$-VAE network and further exploration of other generative network models.
title Synergistic PET/CT Reconstruction Using a Joint Generative Model
topic Medical Physics
url https://arxiv.org/abs/2411.07339