Predicting fluorescent labels in label-free microscopy images with pix2pix and adaptive loss in Light My Cells challenge

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Han, Li, Hao, Wang, Jiacheng, Fan, Yubo, Xu, Zhoubing, Oguz, Ipek
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914845132062720
author Liu, Han
Li, Hao
Wang, Jiacheng
Fan, Yubo
Xu, Zhoubing
Oguz, Ipek
author_facet Liu, Han
Li, Hao
Wang, Jiacheng
Fan, Yubo
Xu, Zhoubing
Oguz, Ipek
contents Fluorescence labeling is the standard approach to reveal cellular structures and other subcellular constituents for microscopy images. However, this invasive procedure may perturb or even kill the cells and the procedure itself is highly time-consuming and complex. Recently, in silico labeling has emerged as a promising alternative, aiming to use machine learning models to directly predict the fluorescently labeled images from label-free microscopy. In this paper, we propose a deep learning-based in silico labeling method for the Light My Cells challenge. Built upon pix2pix, our proposed method can be trained using the partially labeled datasets with an adaptive loss. Moreover, we explore the effectiveness of several training strategies to handle different input modalities, such as training them together or separately. The results show that our method achieves promising performance for in silico labeling. Our code is available at https://github.com/MedICL-VU/LightMyCells.
format Preprint
id arxiv_https___arxiv_org_abs_2406_15716
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Predicting fluorescent labels in label-free microscopy images with pix2pix and adaptive loss in Light My Cells challenge
Liu, Han
Li, Hao
Wang, Jiacheng
Fan, Yubo
Xu, Zhoubing
Oguz, Ipek
Image and Video Processing
Computer Vision and Pattern Recognition
Fluorescence labeling is the standard approach to reveal cellular structures and other subcellular constituents for microscopy images. However, this invasive procedure may perturb or even kill the cells and the procedure itself is highly time-consuming and complex. Recently, in silico labeling has emerged as a promising alternative, aiming to use machine learning models to directly predict the fluorescently labeled images from label-free microscopy. In this paper, we propose a deep learning-based in silico labeling method for the Light My Cells challenge. Built upon pix2pix, our proposed method can be trained using the partially labeled datasets with an adaptive loss. Moreover, we explore the effectiveness of several training strategies to handle different input modalities, such as training them together or separately. The results show that our method achieves promising performance for in silico labeling. Our code is available at https://github.com/MedICL-VU/LightMyCells.
title Predicting fluorescent labels in label-free microscopy images with pix2pix and adaptive loss in Light My Cells challenge
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.15716