CyclePose -- Leveraging Cycle-Consistency for Annotation-Free Nuclei Segmentation in Fluorescence Microscopy

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Utz, Jonas, Vocht, Stefan, Buessen, Anne Tjorven, Possart, Dennis, Wagner, Fabian, Thies, Mareike, Gu, Mingxuan, Uderhardt, Stefan, Breininger, Katharina
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910911551242240
author Utz, Jonas
Vocht, Stefan
Buessen, Anne Tjorven
Possart, Dennis
Wagner, Fabian
Thies, Mareike
Gu, Mingxuan
Uderhardt, Stefan
Breininger, Katharina
author_facet Utz, Jonas
Vocht, Stefan
Buessen, Anne Tjorven
Possart, Dennis
Wagner, Fabian
Thies, Mareike
Gu, Mingxuan
Uderhardt, Stefan
Breininger, Katharina
contents In recent years, numerous neural network architectures specifically designed for the instance segmentation of nuclei in microscopic images have been released. These models embed nuclei-specific priors to outperform generic architectures like U-Nets; however, they require large annotated datasets, which are often not available. Generative models (GANs, diffusion models) have been used to compensate for this by synthesizing training data. These two-stage approaches are computationally expensive, as first a generative model and then a segmentation model has to be trained. We propose CyclePose, a hybrid framework integrating synthetic data generation and segmentation training. CyclePose builds on a CycleGAN architecture, which allows unpaired translation between microscopy images and segmentation masks. We embed a segmentation model into CycleGAN and leverage a cycle consistency loss for self-supervision. Without annotated data, CyclePose outperforms other weakly or unsupervised methods on two public datasets. Code is available at https://github.com/jonasutz/CyclePose
format Preprint
id arxiv_https___arxiv_org_abs_2503_11266
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CyclePose -- Leveraging Cycle-Consistency for Annotation-Free Nuclei Segmentation in Fluorescence Microscopy
Utz, Jonas
Vocht, Stefan
Buessen, Anne Tjorven
Possart, Dennis
Wagner, Fabian
Thies, Mareike
Gu, Mingxuan
Uderhardt, Stefan
Breininger, Katharina
Computer Vision and Pattern Recognition
In recent years, numerous neural network architectures specifically designed for the instance segmentation of nuclei in microscopic images have been released. These models embed nuclei-specific priors to outperform generic architectures like U-Nets; however, they require large annotated datasets, which are often not available. Generative models (GANs, diffusion models) have been used to compensate for this by synthesizing training data. These two-stage approaches are computationally expensive, as first a generative model and then a segmentation model has to be trained. We propose CyclePose, a hybrid framework integrating synthetic data generation and segmentation training. CyclePose builds on a CycleGAN architecture, which allows unpaired translation between microscopy images and segmentation masks. We embed a segmentation model into CycleGAN and leverage a cycle consistency loss for self-supervision. Without annotated data, CyclePose outperforms other weakly or unsupervised methods on two public datasets. Code is available at https://github.com/jonasutz/CyclePose
title CyclePose -- Leveraging Cycle-Consistency for Annotation-Free Nuclei Segmentation in Fluorescence Microscopy
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.11266