Enabling High-Quality In-the-Wild Imaging from Severely Aberrated Metalens Bursts

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Mandal, Debabrata, Peng, Zhihan, Wang, Yujie, Chakravarthula, Praneeth
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914087656488960
author Mandal, Debabrata
Peng, Zhihan
Wang, Yujie
Chakravarthula, Praneeth
author_facet Mandal, Debabrata
Peng, Zhihan
Wang, Yujie
Chakravarthula, Praneeth
contents We tackle the challenge of robust, in-the-wild imaging using ultra-thin nanophotonic metalens cameras. Meta-lenses, composed of planar arrays of nanoscale scatterers, promise dramatic reductions in size and weight compared to conventional refractive optics. However, severe chromatic aberration, pronounced light scattering, narrow spectral bandwidth, and low light efficiency continue to limit their practical adoption. In this work, we present an end-to-end solution for in-the-wild imaging that pairs a metalens several times thinner than conventional optics with a bespoke multi-image restoration framework optimized for practical metalens cameras. Our method centers on a lightweight convolutional network paired with a memory-efficient burst fusion algorithm that adaptively corrects noise, saturation clipping, and lens-induced distortions across rapid sequences of extremely degraded metalens captures. Extensive experiments on diverse, real-world handheld captures demonstrate that our approach consistently outperforms existing burst-mode and single-image restoration techniques.These results point toward a practical route for deploying metalens-based cameras in everyday imaging applications.
format Preprint
id arxiv_https___arxiv_org_abs_2510_10083
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enabling High-Quality In-the-Wild Imaging from Severely Aberrated Metalens Bursts
Mandal, Debabrata
Peng, Zhihan
Wang, Yujie
Chakravarthula, Praneeth
Optics
Computer Vision and Pattern Recognition
We tackle the challenge of robust, in-the-wild imaging using ultra-thin nanophotonic metalens cameras. Meta-lenses, composed of planar arrays of nanoscale scatterers, promise dramatic reductions in size and weight compared to conventional refractive optics. However, severe chromatic aberration, pronounced light scattering, narrow spectral bandwidth, and low light efficiency continue to limit their practical adoption. In this work, we present an end-to-end solution for in-the-wild imaging that pairs a metalens several times thinner than conventional optics with a bespoke multi-image restoration framework optimized for practical metalens cameras. Our method centers on a lightweight convolutional network paired with a memory-efficient burst fusion algorithm that adaptively corrects noise, saturation clipping, and lens-induced distortions across rapid sequences of extremely degraded metalens captures. Extensive experiments on diverse, real-world handheld captures demonstrate that our approach consistently outperforms existing burst-mode and single-image restoration techniques.These results point toward a practical route for deploying metalens-based cameras in everyday imaging applications.
title Enabling High-Quality In-the-Wild Imaging from Severely Aberrated Metalens Bursts
topic Optics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.10083