Polarization Multi-Image Synthesis with Birefringent Metasurfaces

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hazineh, Dean, Lim, Soon Wei Daniel, Guo, Qi, Capasso, Federico, Zickler, Todd
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912466599936000
author Hazineh, Dean
Lim, Soon Wei Daniel
Guo, Qi
Capasso, Federico
Zickler, Todd
author_facet Hazineh, Dean
Lim, Soon Wei Daniel
Guo, Qi
Capasso, Federico
Zickler, Todd
contents Optical metasurfaces composed of precisely engineered nanostructures have gained significant attention for their ability to manipulate light and implement distinct functionalities based on the properties of the incident field. Computational imaging systems have started harnessing this capability to produce sets of coded measurements that benefit certain tasks when paired with digital post-processing. Inspired by these works, we introduce a new system that uses a birefringent metasurface with a polarizer-mosaicked photosensor to capture four optically-coded measurements in a single exposure. We apply this system to the task of incoherent opto-electronic filtering, where digital spatial-filtering operations are replaced by simpler, per-pixel sums across the four polarization channels, independent of the spatial filter size. In contrast to previous work on incoherent opto-electronic filtering that can realize only one spatial filter, our approach can realize a continuous family of filters from a single capture, with filters being selected from the family by adjusting the post-capture digital summation weights. To find a metasurface that can realize a set of user-specified spatial filters, we introduce a form of gradient descent with a novel regularizer that encourages light efficiency and a high signal-to-noise ratio. We demonstrate several examples in simulation and with fabricated prototypes, including some with spatial filters that have prescribed variations with respect to depth and wavelength. Visit the Project Page at https://deanhazineh.github.io/publications/Multi_Image_Synthesis/MIS_Home.html
format Preprint
id arxiv_https___arxiv_org_abs_2307_08106
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Polarization Multi-Image Synthesis with Birefringent Metasurfaces
Hazineh, Dean
Lim, Soon Wei Daniel
Guo, Qi
Capasso, Federico
Zickler, Todd
Computer Vision and Pattern Recognition
Optics
Optical metasurfaces composed of precisely engineered nanostructures have gained significant attention for their ability to manipulate light and implement distinct functionalities based on the properties of the incident field. Computational imaging systems have started harnessing this capability to produce sets of coded measurements that benefit certain tasks when paired with digital post-processing. Inspired by these works, we introduce a new system that uses a birefringent metasurface with a polarizer-mosaicked photosensor to capture four optically-coded measurements in a single exposure. We apply this system to the task of incoherent opto-electronic filtering, where digital spatial-filtering operations are replaced by simpler, per-pixel sums across the four polarization channels, independent of the spatial filter size. In contrast to previous work on incoherent opto-electronic filtering that can realize only one spatial filter, our approach can realize a continuous family of filters from a single capture, with filters being selected from the family by adjusting the post-capture digital summation weights. To find a metasurface that can realize a set of user-specified spatial filters, we introduce a form of gradient descent with a novel regularizer that encourages light efficiency and a high signal-to-noise ratio. We demonstrate several examples in simulation and with fabricated prototypes, including some with spatial filters that have prescribed variations with respect to depth and wavelength. Visit the Project Page at https://deanhazineh.github.io/publications/Multi_Image_Synthesis/MIS_Home.html
title Polarization Multi-Image Synthesis with Birefringent Metasurfaces
topic Computer Vision and Pattern Recognition
Optics
url https://arxiv.org/abs/2307.08106