Saved in:
Bibliographic Details
Main Authors: Banerjee, Abeer, Singh, Sanjay
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.18189
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913588285800448
author Banerjee, Abeer
Singh, Sanjay
author_facet Banerjee, Abeer
Singh, Sanjay
contents The field of computational imaging has witnessed a promising paradigm shift with the emergence of untrained neural networks, offering novel solutions to inverse computational imaging problems. While existing techniques have demonstrated impressive results, they often operate either in the high-data regime, leveraging Generative Adversarial Networks (GANs) as image priors, or through untrained iterative reconstruction in a data-agnostic manner. This paper delves into lensless image reconstruction, a subset of computational imaging that replaces traditional lenses with computation, enabling the development of ultra-thin and lightweight imaging systems. To the best of our knowledge, we are the first to leverage implicit neural representations for lensless image deblurring, achieving reconstructions without the requirement of prior training. We perform prior-embedded untrained iterative optimization to enhance reconstruction performance and speed up convergence, effectively bridging the gap between the no-data and high-data regimes. Through a thorough comparative analysis encompassing various untrained and low-shot methods, including under-parameterized non-convolutional methods and domain-restricted low-shot methods, we showcase the superior performance of our approach by a significant margin.
format Preprint
id arxiv_https___arxiv_org_abs_2411_18189
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regime
Banerjee, Abeer
Singh, Sanjay
Image and Video Processing
Computer Vision and Pattern Recognition
The field of computational imaging has witnessed a promising paradigm shift with the emergence of untrained neural networks, offering novel solutions to inverse computational imaging problems. While existing techniques have demonstrated impressive results, they often operate either in the high-data regime, leveraging Generative Adversarial Networks (GANs) as image priors, or through untrained iterative reconstruction in a data-agnostic manner. This paper delves into lensless image reconstruction, a subset of computational imaging that replaces traditional lenses with computation, enabling the development of ultra-thin and lightweight imaging systems. To the best of our knowledge, we are the first to leverage implicit neural representations for lensless image deblurring, achieving reconstructions without the requirement of prior training. We perform prior-embedded untrained iterative optimization to enhance reconstruction performance and speed up convergence, effectively bridging the gap between the no-data and high-data regimes. Through a thorough comparative analysis encompassing various untrained and low-shot methods, including under-parameterized non-convolutional methods and domain-restricted low-shot methods, we showcase the superior performance of our approach by a significant margin.
title Towards Lensless Image Deblurring with Prior-Embedded Implicit Neural Representations in the Low-Data Regime
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.18189