Nellie: Automated organelle segmentation, tracking, and hierarchical feature extraction in 2D/3D live-cell microscopy

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lefebvre, Austin E. Y. T., Sturm, Gabriel, Lin, Ting-Yu, Stoops, Emily, Lopez, Magdalena Preciado, Kaufmann-Malaga, Benjamin, Hake, Kayley
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909515607179264
author Lefebvre, Austin E. Y. T.
Sturm, Gabriel
Lin, Ting-Yu
Stoops, Emily
Lopez, Magdalena Preciado
Kaufmann-Malaga, Benjamin
Hake, Kayley
author_facet Lefebvre, Austin E. Y. T.
Sturm, Gabriel
Lin, Ting-Yu
Stoops, Emily
Lopez, Magdalena Preciado
Kaufmann-Malaga, Benjamin
Hake, Kayley
contents The analysis of dynamic organelles remains a formidable challenge, though key to understanding biological processes. We introduce Nellie, an automated and unbiased user-friendly pipeline for segmentation, tracking, and feature extraction of diverse intracellular structures. Nellie adapts to image metadata, eliminating user input. Nellie's preprocessing pipeline enhances structural contrast on multiple intracellular scales allowing for robust hierarchical segmentation of sub-organellar regions. Internal motion capture markers are generated and tracked via a radius-adaptive pattern matching scheme, and used as guides for sub-voxel flow interpolation. Nellie extracts a plethora of features at multiple hierarchical levels for deep and customizable analysis. Nellie features a point-and-click Napari-based GUI that allows for code-free operation and visualization, while its modular open-source codebase invites extension by experienced users. We demonstrate Nellie's wide variety of use cases with three examples: unmixing multiple organelles from a single channel using feature-based classification, training an unsupervised graph autoencoder on mitochondrial multi-mesh graphs to quantify latent space embedding changes following ionomycin treatment, and performing in-depth characterization and comparison of endoplasmic reticulum networks across different cell types and temporal frames.
format Preprint
id arxiv_https___arxiv_org_abs_2403_13214
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Nellie: Automated organelle segmentation, tracking, and hierarchical feature extraction in 2D/3D live-cell microscopy
Lefebvre, Austin E. Y. T.
Sturm, Gabriel
Lin, Ting-Yu
Stoops, Emily
Lopez, Magdalena Preciado
Kaufmann-Malaga, Benjamin
Hake, Kayley
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Quantitative Methods
The analysis of dynamic organelles remains a formidable challenge, though key to understanding biological processes. We introduce Nellie, an automated and unbiased user-friendly pipeline for segmentation, tracking, and feature extraction of diverse intracellular structures. Nellie adapts to image metadata, eliminating user input. Nellie's preprocessing pipeline enhances structural contrast on multiple intracellular scales allowing for robust hierarchical segmentation of sub-organellar regions. Internal motion capture markers are generated and tracked via a radius-adaptive pattern matching scheme, and used as guides for sub-voxel flow interpolation. Nellie extracts a plethora of features at multiple hierarchical levels for deep and customizable analysis. Nellie features a point-and-click Napari-based GUI that allows for code-free operation and visualization, while its modular open-source codebase invites extension by experienced users. We demonstrate Nellie's wide variety of use cases with three examples: unmixing multiple organelles from a single channel using feature-based classification, training an unsupervised graph autoencoder on mitochondrial multi-mesh graphs to quantify latent space embedding changes following ionomycin treatment, and performing in-depth characterization and comparison of endoplasmic reticulum networks across different cell types and temporal frames.
title Nellie: Automated organelle segmentation, tracking, and hierarchical feature extraction in 2D/3D live-cell microscopy
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Quantitative Methods
url https://arxiv.org/abs/2403.13214