Semi-supervised variational autoencoder for cell feature extraction in multiplexed immunofluorescence images

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sandarenu, Piumi, Chen, Julia, Slapetova, Iveta, Browne, Lois, Graham, Peter H., Swarbrick, Alexander, Millar, Ewan K. A., Song, Yang, Meijering, Erik
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910505290956800
author Sandarenu, Piumi
Chen, Julia
Slapetova, Iveta
Browne, Lois
Graham, Peter H.
Swarbrick, Alexander
Millar, Ewan K. A.
Song, Yang
Meijering, Erik
author_facet Sandarenu, Piumi
Chen, Julia
Slapetova, Iveta
Browne, Lois
Graham, Peter H.
Swarbrick, Alexander
Millar, Ewan K. A.
Song, Yang
Meijering, Erik
contents Advancements in digital imaging technologies have sparked increased interest in using multiplexed immunofluorescence (mIF) images to visualise and identify the interactions between specific immunophenotypes with the tumour microenvironment at the cellular level. Current state-of-the-art multiplexed immunofluorescence image analysis pipelines depend on cell feature representations characterised by morphological and stain intensity-based metrics generated using simple statistical and machine learning-based tools. However, these methods are not capable of generating complex representations of cells. We propose a deep learning-based cell feature extraction model using a variational autoencoder with supervision using a latent subspace to extract cell features in mIF images. We perform cell phenotype classification using a cohort of more than 44,000 multiplexed immunofluorescence cell image patches extracted across 1,093 tissue microarray cores of breast cancer patients, to demonstrate the success of our model against current and alternative methods.
format Preprint
id arxiv_https___arxiv_org_abs_2406_15727
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Semi-supervised variational autoencoder for cell feature extraction in multiplexed immunofluorescence images
Sandarenu, Piumi
Chen, Julia
Slapetova, Iveta
Browne, Lois
Graham, Peter H.
Swarbrick, Alexander
Millar, Ewan K. A.
Song, Yang
Meijering, Erik
Image and Video Processing
Computer Vision and Pattern Recognition
Advancements in digital imaging technologies have sparked increased interest in using multiplexed immunofluorescence (mIF) images to visualise and identify the interactions between specific immunophenotypes with the tumour microenvironment at the cellular level. Current state-of-the-art multiplexed immunofluorescence image analysis pipelines depend on cell feature representations characterised by morphological and stain intensity-based metrics generated using simple statistical and machine learning-based tools. However, these methods are not capable of generating complex representations of cells. We propose a deep learning-based cell feature extraction model using a variational autoencoder with supervision using a latent subspace to extract cell features in mIF images. We perform cell phenotype classification using a cohort of more than 44,000 multiplexed immunofluorescence cell image patches extracted across 1,093 tissue microarray cores of breast cancer patients, to demonstrate the success of our model against current and alternative methods.
title Semi-supervised variational autoencoder for cell feature extraction in multiplexed immunofluorescence images
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.15727