DAWN-FM: Data-Aware and Noise-Informed Flow Matching for Solving Inverse Problems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ahamed, Shadab, Haber, Eldad
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914359477796864
author Ahamed, Shadab
Haber, Eldad
author_facet Ahamed, Shadab
Haber, Eldad
contents Inverse problems, which involve estimating parameters from incomplete or noisy observations, arise in various fields such as medical imaging, geophysics, and signal processing. These problems are often ill-posed, requiring regularization techniques to stabilize the solution. In this work, we employ Flow Matching (FM), a generative framework that integrates a deterministic processes to map a simple reference distribution, such as a Gaussian, to the target distribution. Our method DAWN-FM: Data-AWare and Noise-Informed Flow Matching incorporates data and noise embedding, allowing the model to access representations about the measured data explicitly and also account for noise in the observations, making it particularly robust in scenarios where data is noisy or incomplete. By learning a time-dependent velocity field, FM not only provides accurate solutions but also enables uncertainty quantification by generating multiple plausible outcomes. Unlike pretrained diffusion models, which may struggle in highly ill-posed settings, our approach is trained specifically for each inverse problem and adapts to varying noise levels. We validate the effectiveness and robustness of our method through extensive numerical experiments on tasks such as image deblurring and tomography. The code is available at: https://github.com/ahxmeds/DAWN-FM.git.
format Preprint
id arxiv_https___arxiv_org_abs_2412_04766
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DAWN-FM: Data-Aware and Noise-Informed Flow Matching for Solving Inverse Problems
Ahamed, Shadab
Haber, Eldad
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
Inverse problems, which involve estimating parameters from incomplete or noisy observations, arise in various fields such as medical imaging, geophysics, and signal processing. These problems are often ill-posed, requiring regularization techniques to stabilize the solution. In this work, we employ Flow Matching (FM), a generative framework that integrates a deterministic processes to map a simple reference distribution, such as a Gaussian, to the target distribution. Our method DAWN-FM: Data-AWare and Noise-Informed Flow Matching incorporates data and noise embedding, allowing the model to access representations about the measured data explicitly and also account for noise in the observations, making it particularly robust in scenarios where data is noisy or incomplete. By learning a time-dependent velocity field, FM not only provides accurate solutions but also enables uncertainty quantification by generating multiple plausible outcomes. Unlike pretrained diffusion models, which may struggle in highly ill-posed settings, our approach is trained specifically for each inverse problem and adapts to varying noise levels. We validate the effectiveness and robustness of our method through extensive numerical experiments on tasks such as image deblurring and tomography. The code is available at: https://github.com/ahxmeds/DAWN-FM.git.
title DAWN-FM: Data-Aware and Noise-Informed Flow Matching for Solving Inverse Problems
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2412.04766