Deep Learning-Enabled Modality Transfer Between Independent Microscopes for High-Throughput Imaging

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Panek, Dominik, Rząca, Carina, Szczypior, Maksymilian, Sorysz, Joanna, Misztal, Krzysztof, Baster, Zbigniew, Rajfur, Zenon
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908971433984000
author Panek, Dominik
Rząca, Carina
Szczypior, Maksymilian
Sorysz, Joanna
Misztal, Krzysztof
Baster, Zbigniew
Rajfur, Zenon
author_facet Panek, Dominik
Rząca, Carina
Szczypior, Maksymilian
Sorysz, Joanna
Misztal, Krzysztof
Baster, Zbigniew
Rajfur, Zenon
contents High-throughput biological imaging is often constrained by a trade-off between acquisition speed and image quality. Fast imaging modalities, such as wide-field fluorescence microscopy, enable large-scale data acquisition but suffer from reduced contrast and resolution, whereas high-resolution techniques, including confocal microscopy or single-molecule localization microscopy-based super-resolution techniques, provide superior image quality at the cost of throughput and instrument time. Here, we present a deep learning-based approach for modality transfer across independent microscopes, enabling the transformation of low-quality images acquired on fast systems into high-quality representations comparable to those obtained using advanced imaging platforms. To achieve this, we employ a generative adversarial network (GAN)-based model trained on paired datasets acquired on physically separate wide-field and confocal microscopes, demonstrating that image quality can be reliably transferred between independent instruments. Quantitative evaluation shows substantial improvement in structural similarity and signal fidelity, with median SSIM and PSNR of 0.94 and 31.87, respectively, compared to 0.83 and 21.48 for the original wide-field images. These results indicate that key structural features can be recovered with high accuracy. Importantly, this approach enables a workflow in which high-throughput imaging can be performed on fast, accessible microscopy systems while preserving the ability to computationally recover high-quality structural information. High-resolution microscopy can then be reserved for targeted validation, reducing acquisition time and improving overall experimental efficiency. Together, our results establish deep learning-enabled modality transfer as a practical strategy for bridging independent microscopy systems and supporting scalable, high-content imaging workflows.
format Preprint
id arxiv_https___arxiv_org_abs_2403_18026
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep Learning-Enabled Modality Transfer Between Independent Microscopes for High-Throughput Imaging
Panek, Dominik
Rząca, Carina
Szczypior, Maksymilian
Sorysz, Joanna
Misztal, Krzysztof
Baster, Zbigniew
Rajfur, Zenon
Image and Video Processing
Machine Learning
Quantitative Methods
High-throughput biological imaging is often constrained by a trade-off between acquisition speed and image quality. Fast imaging modalities, such as wide-field fluorescence microscopy, enable large-scale data acquisition but suffer from reduced contrast and resolution, whereas high-resolution techniques, including confocal microscopy or single-molecule localization microscopy-based super-resolution techniques, provide superior image quality at the cost of throughput and instrument time. Here, we present a deep learning-based approach for modality transfer across independent microscopes, enabling the transformation of low-quality images acquired on fast systems into high-quality representations comparable to those obtained using advanced imaging platforms. To achieve this, we employ a generative adversarial network (GAN)-based model trained on paired datasets acquired on physically separate wide-field and confocal microscopes, demonstrating that image quality can be reliably transferred between independent instruments. Quantitative evaluation shows substantial improvement in structural similarity and signal fidelity, with median SSIM and PSNR of 0.94 and 31.87, respectively, compared to 0.83 and 21.48 for the original wide-field images. These results indicate that key structural features can be recovered with high accuracy. Importantly, this approach enables a workflow in which high-throughput imaging can be performed on fast, accessible microscopy systems while preserving the ability to computationally recover high-quality structural information. High-resolution microscopy can then be reserved for targeted validation, reducing acquisition time and improving overall experimental efficiency. Together, our results establish deep learning-enabled modality transfer as a practical strategy for bridging independent microscopy systems and supporting scalable, high-content imaging workflows.
title Deep Learning-Enabled Modality Transfer Between Independent Microscopes for High-Throughput Imaging
topic Image and Video Processing
Machine Learning
Quantitative Methods
url https://arxiv.org/abs/2403.18026