Multibranch Generative Models for Multichannel Imaging with an Application to PET/CT Synergistic Reconstruction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pinton, Noel Jeffrey, Bousse, Alexandre, Cheze-Le-Rest, Catherine, Visvikis, Dimitris
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909472241221632
author Pinton, Noel Jeffrey
Bousse, Alexandre
Cheze-Le-Rest, Catherine
Visvikis, Dimitris
author_facet Pinton, Noel Jeffrey
Bousse, Alexandre
Cheze-Le-Rest, Catherine
Visvikis, Dimitris
contents This paper presents a novel approach for learned synergistic reconstruction of medical images using multibranch generative models. Leveraging variational autoencoders (VAEs), our model learns from pairs of images simultaneously, enabling effective denoising and reconstruction. Synergistic image reconstruction is achieved by incorporating the trained models in a regularizer that evaluates the distance between the images and the model. We demonstrate the efficacy of our approach on both Modified National Institute of Standards and Technology (MNIST) and positron emission tomography (PET)/computed tomography (CT) datasets, showcasing improved image quality for low-dose imaging. Despite challenges such as patch decomposition and model limitations, our results underscore the potential of generative models for enhancing medical imaging reconstruction.
format Preprint
id arxiv_https___arxiv_org_abs_2404_08748
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multibranch Generative Models for Multichannel Imaging with an Application to PET/CT Synergistic Reconstruction
Pinton, Noel Jeffrey
Bousse, Alexandre
Cheze-Le-Rest, Catherine
Visvikis, Dimitris
Image and Video Processing
Computer Vision and Pattern Recognition
Medical Physics
This paper presents a novel approach for learned synergistic reconstruction of medical images using multibranch generative models. Leveraging variational autoencoders (VAEs), our model learns from pairs of images simultaneously, enabling effective denoising and reconstruction. Synergistic image reconstruction is achieved by incorporating the trained models in a regularizer that evaluates the distance between the images and the model. We demonstrate the efficacy of our approach on both Modified National Institute of Standards and Technology (MNIST) and positron emission tomography (PET)/computed tomography (CT) datasets, showcasing improved image quality for low-dose imaging. Despite challenges such as patch decomposition and model limitations, our results underscore the potential of generative models for enhancing medical imaging reconstruction.
title Multibranch Generative Models for Multichannel Imaging with an Application to PET/CT Synergistic Reconstruction
topic Image and Video Processing
Computer Vision and Pattern Recognition
Medical Physics
url https://arxiv.org/abs/2404.08748