Large-scale compressive microscopy via diffractive multiplexing across a sensor array

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhou, Kevin C., Gu, Chaoying, Ikeda, Muneki, Hayward, Tina M., Antipa, Nicholas, Menon, Rajesh, Horstmeyer, Roarke, Kato, Saul, Waller, Laura
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913949567418368
author Zhou, Kevin C.
Gu, Chaoying
Ikeda, Muneki
Hayward, Tina M.
Antipa, Nicholas
Menon, Rajesh
Horstmeyer, Roarke
Kato, Saul
Waller, Laura
author_facet Zhou, Kevin C.
Gu, Chaoying
Ikeda, Muneki
Hayward, Tina M.
Antipa, Nicholas
Menon, Rajesh
Horstmeyer, Roarke
Kato, Saul
Waller, Laura
contents Microscopes face a trade-off between spatial resolution, field-of-view, and frame rate -- improving one of these properties typically requires sacrificing the others, due to the limited spatiotemporal throughput of the sensor. To overcome this, we propose a new microscope that achieves snapshot gigapixel-scale imaging with a sensor array and a diffractive optical element (DOE). We improve the spatiotemporal throughput in two ways. First, we capture data with an array of 48 sensors resulting in 48x more pixels than a single sensor. Second, we use point spread function (PSF) engineering and compressive sensing algorithms to fill in the missing information from the gaps surrounding the individual sensors in the array, further increasing the spatiotemporal throughput of the system by an additional >5.4x. The array of sensors is modeled as a single large-format "super-sensor," with erasures corresponding to the gaps between the individual sensors. The array is placed at the output of a (nearly) 4f imaging system, and we design a DOE for the Fourier plane that generates a distributed PSF that encodes information from the entire super-sensor area, including the gaps. We then computationally recover the large-scale image, assuming the object is sparse in some domain. Our calibration-free microscope can achieve ~3 μm resolution over >5.2 cm^2 FOVs at up to 120 fps, culminating in a total spatiotemporal throughput of 25.2 billion pixels per second. We demonstrate the versatility of our microscope in two different modes: structural imaging via darkfield contrast and functional fluorescence imaging of calcium dynamics across dozens of freely moving C. elegans simultaneously.
format Preprint
id arxiv_https___arxiv_org_abs_2507_14437
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Large-scale compressive microscopy via diffractive multiplexing across a sensor array
Zhou, Kevin C.
Gu, Chaoying
Ikeda, Muneki
Hayward, Tina M.
Antipa, Nicholas
Menon, Rajesh
Horstmeyer, Roarke
Kato, Saul
Waller, Laura
Optics
Image and Video Processing
Microscopes face a trade-off between spatial resolution, field-of-view, and frame rate -- improving one of these properties typically requires sacrificing the others, due to the limited spatiotemporal throughput of the sensor. To overcome this, we propose a new microscope that achieves snapshot gigapixel-scale imaging with a sensor array and a diffractive optical element (DOE). We improve the spatiotemporal throughput in two ways. First, we capture data with an array of 48 sensors resulting in 48x more pixels than a single sensor. Second, we use point spread function (PSF) engineering and compressive sensing algorithms to fill in the missing information from the gaps surrounding the individual sensors in the array, further increasing the spatiotemporal throughput of the system by an additional >5.4x. The array of sensors is modeled as a single large-format "super-sensor," with erasures corresponding to the gaps between the individual sensors. The array is placed at the output of a (nearly) 4f imaging system, and we design a DOE for the Fourier plane that generates a distributed PSF that encodes information from the entire super-sensor area, including the gaps. We then computationally recover the large-scale image, assuming the object is sparse in some domain. Our calibration-free microscope can achieve ~3 μm resolution over >5.2 cm^2 FOVs at up to 120 fps, culminating in a total spatiotemporal throughput of 25.2 billion pixels per second. We demonstrate the versatility of our microscope in two different modes: structural imaging via darkfield contrast and functional fluorescence imaging of calcium dynamics across dozens of freely moving C. elegans simultaneously.
title Large-scale compressive microscopy via diffractive multiplexing across a sensor array
topic Optics
Image and Video Processing
url https://arxiv.org/abs/2507.14437