Unmixing Optical Signals from Undersampled Volumetric Measurements by Filtering the Pixel Latent Variables

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bouchard, Catherine, Deschênes, Andréanne, Boulanger, Vincent, Bellavance, Jean-Michel, Chabbert, Julia, Pelletier-Rioux, Alexy, Lavoie-Cardinal, Flavie, Gagné, Christian
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908446831411200
author Bouchard, Catherine
Deschênes, Andréanne
Boulanger, Vincent
Bellavance, Jean-Michel
Chabbert, Julia
Pelletier-Rioux, Alexy
Lavoie-Cardinal, Flavie
Gagné, Christian
author_facet Bouchard, Catherine
Deschênes, Andréanne
Boulanger, Vincent
Bellavance, Jean-Michel
Chabbert, Julia
Pelletier-Rioux, Alexy
Lavoie-Cardinal, Flavie
Gagné, Christian
contents The development of signal unmixing algorithms is essential for leveraging multimodal datasets acquired through a wide array of scientific imaging technologies, including hyperspectral or time-resolved acquisitions. In experimental physics, enhancing the spatio-temporal resolution or expanding the number of detection channels often leads to diminished sampling rate and signal-to-noise ratio, significantly affecting the efficacy of signal unmixing algorithms. We propose Latent Unmixing, a new approach which applies bandpass filters to the latent space of a multidimensional convolutional neural network to disentangle overlapping signal components. It enables better isolation and quantification of individual signal contributions, especially in the context of undersampled distributions. Using multidimensional convolution kernels to process all dimensions simultaneously enhances the network's ability to extract information from adjacent pixels, and time or spectral bins. This approach enables more effective separation of components in cases where individual pixels do not provide clear, well-resolved information. We showcase the method's practical use in experimental physics through two test cases that highlight the versatility of our approach: fluorescence lifetime microscopy and mode decomposition in optical fibers. The latent unmixing method extracts valuable information from complex signals that cannot be resolved by standard methods. It opens up new possibilities in optics and photonics for multichannel separation at an increased sampling rate.
format Preprint
id arxiv_https___arxiv_org_abs_2312_05357
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Unmixing Optical Signals from Undersampled Volumetric Measurements by Filtering the Pixel Latent Variables
Bouchard, Catherine
Deschênes, Andréanne
Boulanger, Vincent
Bellavance, Jean-Michel
Chabbert, Julia
Pelletier-Rioux, Alexy
Lavoie-Cardinal, Flavie
Gagné, Christian
Image and Video Processing
Computer Vision and Pattern Recognition
The development of signal unmixing algorithms is essential for leveraging multimodal datasets acquired through a wide array of scientific imaging technologies, including hyperspectral or time-resolved acquisitions. In experimental physics, enhancing the spatio-temporal resolution or expanding the number of detection channels often leads to diminished sampling rate and signal-to-noise ratio, significantly affecting the efficacy of signal unmixing algorithms. We propose Latent Unmixing, a new approach which applies bandpass filters to the latent space of a multidimensional convolutional neural network to disentangle overlapping signal components. It enables better isolation and quantification of individual signal contributions, especially in the context of undersampled distributions. Using multidimensional convolution kernels to process all dimensions simultaneously enhances the network's ability to extract information from adjacent pixels, and time or spectral bins. This approach enables more effective separation of components in cases where individual pixels do not provide clear, well-resolved information. We showcase the method's practical use in experimental physics through two test cases that highlight the versatility of our approach: fluorescence lifetime microscopy and mode decomposition in optical fibers. The latent unmixing method extracts valuable information from complex signals that cannot be resolved by standard methods. It opens up new possibilities in optics and photonics for multichannel separation at an increased sampling rate.
title Unmixing Optical Signals from Undersampled Volumetric Measurements by Filtering the Pixel Latent Variables
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2312.05357