Solving Inverse Problems using Diffusion with Iterative Colored Renoising

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Bendel, Matt C., Shastri, Saurav K., Ahmad, Rizwan, Schniter, Philip
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911123740033024
author Bendel, Matt C.
Shastri, Saurav K.
Ahmad, Rizwan
Schniter, Philip
author_facet Bendel, Matt C.
Shastri, Saurav K.
Ahmad, Rizwan
Schniter, Philip
contents Imaging inverse problems can be solved in an unsupervised manner using pre-trained diffusion models, but doing so requires approximating the gradient of the measurement-conditional score function in the diffusion reverse process. We show that the approximations produced by existing methods are relatively poor, especially early in the reverse process, and so we propose a new approach that iteratively reestimates and "renoises" the estimate several times per diffusion step. This iterative approach, which we call Fast Iterative REnoising (FIRE), injects colored noise that is shaped to ensure that the pre-trained diffusion model always sees white noise, in accordance with how it was trained. We then embed FIRE into the DDIM reverse process and show that the resulting "DDfire" offers state-of-the-art accuracy and runtime on several linear inverse problems, as well as phase retrieval. Our implementation is at https://github.com/matt-bendel/DDfire
format Preprint
id arxiv_https___arxiv_org_abs_2501_17468
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Solving Inverse Problems using Diffusion with Iterative Colored Renoising
Bendel, Matt C.
Shastri, Saurav K.
Ahmad, Rizwan
Schniter, Philip
Computer Vision and Pattern Recognition
Imaging inverse problems can be solved in an unsupervised manner using pre-trained diffusion models, but doing so requires approximating the gradient of the measurement-conditional score function in the diffusion reverse process. We show that the approximations produced by existing methods are relatively poor, especially early in the reverse process, and so we propose a new approach that iteratively reestimates and "renoises" the estimate several times per diffusion step. This iterative approach, which we call Fast Iterative REnoising (FIRE), injects colored noise that is shaped to ensure that the pre-trained diffusion model always sees white noise, in accordance with how it was trained. We then embed FIRE into the DDIM reverse process and show that the resulting "DDfire" offers state-of-the-art accuracy and runtime on several linear inverse problems, as well as phase retrieval. Our implementation is at https://github.com/matt-bendel/DDfire
title Solving Inverse Problems using Diffusion with Iterative Colored Renoising
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.17468