Saved in:
Bibliographic Details
Main Authors: Bando, Yosuke, Pillai, Ramdas, Kajita, Atsushi, Hakeem, Farhan Abdul, Quemener, Yves, Tseng, Hua-an, Piatkevich, Kiryl D., Linghu, Changyang, Han, Xue, Boyden, Edward S.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.16438
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911812060971008
author Bando, Yosuke
Pillai, Ramdas
Kajita, Atsushi
Hakeem, Farhan Abdul
Quemener, Yves
Tseng, Hua-an
Piatkevich, Kiryl D.
Linghu, Changyang
Han, Xue
Boyden, Edward S.
author_facet Bando, Yosuke
Pillai, Ramdas
Kajita, Atsushi
Hakeem, Farhan Abdul
Quemener, Yves
Tseng, Hua-an
Piatkevich, Kiryl D.
Linghu, Changyang
Han, Xue
Boyden, Edward S.
contents In voltage imaging, where the membrane potentials of individual neurons are recorded at from hundreds to thousand frames per second using fluorescence microscopy, data processing presents a challenge. Even a fraction of a minute of recording with a limited image size yields gigabytes of video data consisting of tens of thousands of frames, which can be time-consuming to process. Moreover, millisecond-level short exposures lead to noisy video frames, obscuring neuron footprints especially in deep-brain samples where noisy signals are buried in background fluorescence. To address this challenge, we propose a fast neuron segmentation method able to detect multiple, potentially overlapping, spiking neurons from noisy video frames, and implement a data processing pipeline incorporating the proposed segmentation method along with GPU-accelerated motion correction. By testing on existing datasets as well as on new datasets we introduce, we show that our pipeline extracts neuron footprints that agree well with human annotation even from cluttered datasets, and demonstrate real-time processing of voltage imaging data on a single desktop computer for the first time.
format Preprint
id arxiv_https___arxiv_org_abs_2403_16438
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Real-time Neuron Segmentation for Voltage Imaging
Bando, Yosuke
Pillai, Ramdas
Kajita, Atsushi
Hakeem, Farhan Abdul
Quemener, Yves
Tseng, Hua-an
Piatkevich, Kiryl D.
Linghu, Changyang
Han, Xue
Boyden, Edward S.
Image and Video Processing
Computer Vision and Pattern Recognition
In voltage imaging, where the membrane potentials of individual neurons are recorded at from hundreds to thousand frames per second using fluorescence microscopy, data processing presents a challenge. Even a fraction of a minute of recording with a limited image size yields gigabytes of video data consisting of tens of thousands of frames, which can be time-consuming to process. Moreover, millisecond-level short exposures lead to noisy video frames, obscuring neuron footprints especially in deep-brain samples where noisy signals are buried in background fluorescence. To address this challenge, we propose a fast neuron segmentation method able to detect multiple, potentially overlapping, spiking neurons from noisy video frames, and implement a data processing pipeline incorporating the proposed segmentation method along with GPU-accelerated motion correction. By testing on existing datasets as well as on new datasets we introduce, we show that our pipeline extracts neuron footprints that agree well with human annotation even from cluttered datasets, and demonstrate real-time processing of voltage imaging data on a single desktop computer for the first time.
title Real-time Neuron Segmentation for Voltage Imaging
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.16438