Reconstructing Interpretable Features in Computational Super-Resolution microscopy via Regularized Latent Search

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gheisari, Marzieh, Genovesio, Auguste
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913580805259264
author Gheisari, Marzieh
Genovesio, Auguste
author_facet Gheisari, Marzieh
Genovesio, Auguste
contents Supervised deep learning approaches can artificially increase the resolution of microscopy images by learning a mapping between two image resolutions or modalities. However, such methods often require a large set of hard-to-get low-res/high-res image pairs and produce synthetic images with a moderate increase in resolution. Conversely, recent methods based on GAN latent search offered a drastic increase in resolution without the need of paired images. However, they offer limited reconstruction of the high-resolution image interpretable features. Here, we propose a robust super-resolution method based on regularized latent search~(RLS) that offers an actionable balance between fidelity to the ground-truth and realism of the recovered image given a distribution prior. The latter allows to split the analysis of a low-resolution image into a computational super-resolution task performed by deep learning followed by a quantification task performed by a handcrafted algorithm and based on interpretable biological features. This two-step process holds potential for various applications such as diagnostics on mobile devices, where the main aim is not to recover the high-resolution details of a specific sample but rather to obtain high-resolution images that preserve explainable and quantifiable differences between conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2405_19112
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Reconstructing Interpretable Features in Computational Super-Resolution microscopy via Regularized Latent Search
Gheisari, Marzieh
Genovesio, Auguste
Image and Video Processing
Computer Vision and Pattern Recognition
Supervised deep learning approaches can artificially increase the resolution of microscopy images by learning a mapping between two image resolutions or modalities. However, such methods often require a large set of hard-to-get low-res/high-res image pairs and produce synthetic images with a moderate increase in resolution. Conversely, recent methods based on GAN latent search offered a drastic increase in resolution without the need of paired images. However, they offer limited reconstruction of the high-resolution image interpretable features. Here, we propose a robust super-resolution method based on regularized latent search~(RLS) that offers an actionable balance between fidelity to the ground-truth and realism of the recovered image given a distribution prior. The latter allows to split the analysis of a low-resolution image into a computational super-resolution task performed by deep learning followed by a quantification task performed by a handcrafted algorithm and based on interpretable biological features. This two-step process holds potential for various applications such as diagnostics on mobile devices, where the main aim is not to recover the high-resolution details of a specific sample but rather to obtain high-resolution images that preserve explainable and quantifiable differences between conditions.
title Reconstructing Interpretable Features in Computational Super-Resolution microscopy via Regularized Latent Search
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.19112