Saved in:
Bibliographic Details
Main Authors: Webber, George, Mizuno, Yuya, Howes, Oliver D., Hammers, Alexander, King, Andrew P., Reader, Andrew J.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.04324
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909417562177536
author Webber, George
Mizuno, Yuya
Howes, Oliver D.
Hammers, Alexander
King, Andrew P.
Reader, Andrew J.
author_facet Webber, George
Mizuno, Yuya
Howes, Oliver D.
Hammers, Alexander
King, Andrew P.
Reader, Andrew J.
contents Large high-quality medical image datasets are difficult to acquire but necessary for many deep learning applications. For positron emission tomography (PET), reconstructed image quality is limited by inherent Poisson noise. We propose a novel method for synthesising diverse and realistic pseudo-PET images with improved signal-to-noise ratio. We also show how our pseudo-PET images may be exploited as a generative prior for single-subject PET image reconstruction. Firstly, we perform deep-learned deformable registration of multi-subject magnetic resonance (MR) images paired to multi-subject PET images. We then use the anatomically-learned deformation fields to transform multiple PET images to the same reference space, before averaging random subsets of the transformed multi-subject data to form a large number of varying pseudo-PET images. We observe that using MR information for registration imbues the resulting pseudo-PET images with improved anatomical detail compared to the originals. We consider applications to PET image reconstruction, by generating pseudo-PET images in the same space as the intended single-subject reconstruction and using them as training data for a diffusion model-based reconstruction method. We show visual improvement and reduced background noise in our 2D reconstructions as compared to OSEM, MAP-EM and an existing state-of-the-art diffusion model-based approach. Our method shows the potential for utilising highly subject-specific prior information within a generative reconstruction framework. Future work may compare the benefits of our approach to explicitly MR-guided reconstruction methodologies.
format Preprint
id arxiv_https___arxiv_org_abs_2412_04324
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multi-Subject Image Synthesis as a Generative Prior for Single-Subject PET Image Reconstruction
Webber, George
Mizuno, Yuya
Howes, Oliver D.
Hammers, Alexander
King, Andrew P.
Reader, Andrew J.
Medical Physics
Computer Vision and Pattern Recognition
Large high-quality medical image datasets are difficult to acquire but necessary for many deep learning applications. For positron emission tomography (PET), reconstructed image quality is limited by inherent Poisson noise. We propose a novel method for synthesising diverse and realistic pseudo-PET images with improved signal-to-noise ratio. We also show how our pseudo-PET images may be exploited as a generative prior for single-subject PET image reconstruction. Firstly, we perform deep-learned deformable registration of multi-subject magnetic resonance (MR) images paired to multi-subject PET images. We then use the anatomically-learned deformation fields to transform multiple PET images to the same reference space, before averaging random subsets of the transformed multi-subject data to form a large number of varying pseudo-PET images. We observe that using MR information for registration imbues the resulting pseudo-PET images with improved anatomical detail compared to the originals. We consider applications to PET image reconstruction, by generating pseudo-PET images in the same space as the intended single-subject reconstruction and using them as training data for a diffusion model-based reconstruction method. We show visual improvement and reduced background noise in our 2D reconstructions as compared to OSEM, MAP-EM and an existing state-of-the-art diffusion model-based approach. Our method shows the potential for utilising highly subject-specific prior information within a generative reconstruction framework. Future work may compare the benefits of our approach to explicitly MR-guided reconstruction methodologies.
title Multi-Subject Image Synthesis as a Generative Prior for Single-Subject PET Image Reconstruction
topic Medical Physics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.04324