PET Image Denoising via Text-Guided Diffusion: Integrating Anatomical Priors through Text Prompts

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Yu, Boxiao, Ozdemir, Savas, Wu, Jiong, Chen, Yizhou, Fang, Ruogu, Shi, Kuangyu, Gong, Kuang
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912252553068544
author Yu, Boxiao
Ozdemir, Savas
Wu, Jiong
Chen, Yizhou
Fang, Ruogu
Shi, Kuangyu
Gong, Kuang
author_facet Yu, Boxiao
Ozdemir, Savas
Wu, Jiong
Chen, Yizhou
Fang, Ruogu
Shi, Kuangyu
Gong, Kuang
contents Low-dose Positron Emission Tomography (PET) imaging presents a significant challenge due to increased noise and reduced image quality, which can compromise its diagnostic accuracy and clinical utility. Denoising diffusion probabilistic models (DDPMs) have demonstrated promising performance for PET image denoising. However, existing DDPM-based methods typically overlook valuable metadata such as patient demographics, anatomical information, and scanning parameters, which should further enhance the denoising performance if considered. Recent advances in vision-language models (VLMs), particularly the pre-trained Contrastive Language-Image Pre-training (CLIP) model, have highlighted the potential of incorporating text-based information into visual tasks to improve downstream performance. In this preliminary study, we proposed a novel text-guided DDPM for PET image denoising that integrated anatomical priors through text prompts. Anatomical text descriptions were encoded using a pre-trained CLIP text encoder to extract semantic guidance, which was then incorporated into the diffusion process via the cross-attention mechanism. Evaluations based on paired 1/20 low-dose and normal-dose 18F-FDG PET datasets demonstrated that the proposed method achieved better quantitative performance than conventional UNet and standard DDPM methods at both the whole-body and organ levels. These results underscored the potential of leveraging VLMs to integrate rich metadata into the diffusion framework to enhance the image quality of low-dose PET scans.
format Preprint
id arxiv_https___arxiv_org_abs_2502_21260
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PET Image Denoising via Text-Guided Diffusion: Integrating Anatomical Priors through Text Prompts
Yu, Boxiao
Ozdemir, Savas
Wu, Jiong
Chen, Yizhou
Fang, Ruogu
Shi, Kuangyu
Gong, Kuang
Image and Video Processing
Low-dose Positron Emission Tomography (PET) imaging presents a significant challenge due to increased noise and reduced image quality, which can compromise its diagnostic accuracy and clinical utility. Denoising diffusion probabilistic models (DDPMs) have demonstrated promising performance for PET image denoising. However, existing DDPM-based methods typically overlook valuable metadata such as patient demographics, anatomical information, and scanning parameters, which should further enhance the denoising performance if considered. Recent advances in vision-language models (VLMs), particularly the pre-trained Contrastive Language-Image Pre-training (CLIP) model, have highlighted the potential of incorporating text-based information into visual tasks to improve downstream performance. In this preliminary study, we proposed a novel text-guided DDPM for PET image denoising that integrated anatomical priors through text prompts. Anatomical text descriptions were encoded using a pre-trained CLIP text encoder to extract semantic guidance, which was then incorporated into the diffusion process via the cross-attention mechanism. Evaluations based on paired 1/20 low-dose and normal-dose 18F-FDG PET datasets demonstrated that the proposed method achieved better quantitative performance than conventional UNet and standard DDPM methods at both the whole-body and organ levels. These results underscored the potential of leveraging VLMs to integrate rich metadata into the diffusion framework to enhance the image quality of low-dose PET scans.
title PET Image Denoising via Text-Guided Diffusion: Integrating Anatomical Priors through Text Prompts
topic Image and Video Processing
url https://arxiv.org/abs/2502.21260