Saved in:
Bibliographic Details
Main Authors: Arslan, Fuat, Kabas, Bilal, Dalmaz, Onat, Ozbey, Muzaffer, Çukur, Tolga
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.06789
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909198006091776
author Arslan, Fuat
Kabas, Bilal
Dalmaz, Onat
Ozbey, Muzaffer
Çukur, Tolga
author_facet Arslan, Fuat
Kabas, Bilal
Dalmaz, Onat
Ozbey, Muzaffer
Çukur, Tolga
contents Denoising diffusion models (DDM) have gained recent traction in medical image translation given improved training stability over adversarial models. DDMs learn a multi-step denoising transformation to progressively map random Gaussian-noise images onto target-modality images, while receiving stationary guidance from source-modality images. As this denoising transformation diverges significantly from the task-relevant source-to-target transformation, DDMs can suffer from weak source-modality guidance. Here, we propose a novel self-consistent recursive diffusion bridge (SelfRDB) for improved performance in medical image translation. Unlike DDMs, SelfRDB employs a novel forward process with start- and end-points defined based on target and source images, respectively. Intermediate image samples across the process are expressed via a normal distribution with mean taken as a convex combination of start-end points, and variance from additive noise. Unlike regular diffusion bridges that prescribe zero variance at start-end points and high variance at mid-point of the process, we propose a novel noise scheduling with monotonically increasing variance towards the end-point in order to boost generalization performance and facilitate information transfer between the two modalities. To further enhance sampling accuracy in each reverse step, we propose a novel sampling procedure where the network recursively generates a transient-estimate of the target image until convergence onto a self-consistent solution. Comprehensive analyses in multi-contrast MRI and MRI-CT translation indicate that SelfRDB offers superior performance against competing methods.
format Preprint
id arxiv_https___arxiv_org_abs_2405_06789
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self-Consistent Recursive Diffusion Bridge for Medical Image Translation
Arslan, Fuat
Kabas, Bilal
Dalmaz, Onat
Ozbey, Muzaffer
Çukur, Tolga
Image and Video Processing
Computer Vision and Pattern Recognition
Denoising diffusion models (DDM) have gained recent traction in medical image translation given improved training stability over adversarial models. DDMs learn a multi-step denoising transformation to progressively map random Gaussian-noise images onto target-modality images, while receiving stationary guidance from source-modality images. As this denoising transformation diverges significantly from the task-relevant source-to-target transformation, DDMs can suffer from weak source-modality guidance. Here, we propose a novel self-consistent recursive diffusion bridge (SelfRDB) for improved performance in medical image translation. Unlike DDMs, SelfRDB employs a novel forward process with start- and end-points defined based on target and source images, respectively. Intermediate image samples across the process are expressed via a normal distribution with mean taken as a convex combination of start-end points, and variance from additive noise. Unlike regular diffusion bridges that prescribe zero variance at start-end points and high variance at mid-point of the process, we propose a novel noise scheduling with monotonically increasing variance towards the end-point in order to boost generalization performance and facilitate information transfer between the two modalities. To further enhance sampling accuracy in each reverse step, we propose a novel sampling procedure where the network recursively generates a transient-estimate of the target image until convergence onto a self-consistent solution. Comprehensive analyses in multi-contrast MRI and MRI-CT translation indicate that SelfRDB offers superior performance against competing methods.
title Self-Consistent Recursive Diffusion Bridge for Medical Image Translation
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.06789