Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2308.14409 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913667233087488 |
|---|---|
| author | Barbano, Riccardo Denker, Alexander Chung, Hyungjin Roh, Tae Hoon Arridge, Simon Maass, Peter Jin, Bangti Ye, Jong Chul |
| author_facet | Barbano, Riccardo Denker, Alexander Chung, Hyungjin Roh, Tae Hoon Arridge, Simon Maass, Peter Jin, Bangti Ye, Jong Chul |
| contents | Denoising diffusion models have emerged as the go-to generative framework for solving inverse problems in imaging. A critical concern regarding these models is their performance on out-of-distribution tasks, which remains an under-explored challenge. Using a diffusion model on an out-of-distribution dataset, realistic reconstructions can be generated, but with hallucinating image features that are uniquely present in the training dataset. To address this discrepancy during train-test time and improve reconstruction accuracy, we introduce a novel sampling framework called Steerable Conditional Diffusion. Specifically, this framework adapts the diffusion model, concurrently with image reconstruction, based solely on the information provided by the available measurement. Utilising our proposed method, we achieve substantial enhancements in out-of-distribution performance across diverse imaging modalities, advancing the robust deployment of denoising diffusion models in real-world applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2308_14409 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Medical Image Reconstruction Barbano, Riccardo Denker, Alexander Chung, Hyungjin Roh, Tae Hoon Arridge, Simon Maass, Peter Jin, Bangti Ye, Jong Chul Computer Vision and Pattern Recognition Machine Learning Denoising diffusion models have emerged as the go-to generative framework for solving inverse problems in imaging. A critical concern regarding these models is their performance on out-of-distribution tasks, which remains an under-explored challenge. Using a diffusion model on an out-of-distribution dataset, realistic reconstructions can be generated, but with hallucinating image features that are uniquely present in the training dataset. To address this discrepancy during train-test time and improve reconstruction accuracy, we introduce a novel sampling framework called Steerable Conditional Diffusion. Specifically, this framework adapts the diffusion model, concurrently with image reconstruction, based solely on the information provided by the available measurement. Utilising our proposed method, we achieve substantial enhancements in out-of-distribution performance across diverse imaging modalities, advancing the robust deployment of denoising diffusion models in real-world applications. |
| title | Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Medical Image Reconstruction |
| topic | Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2308.14409 |