Saved in:
Bibliographic Details
Main Authors: da Graca, Mario de Jesus, Dahlkemper, Jörg, Stelldinger, Peer
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2512.00078
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917113368674304
author da Graca, Mario de Jesus
Dahlkemper, Jörg
Stelldinger, Peer
author_facet da Graca, Mario de Jesus
Dahlkemper, Jörg
Stelldinger, Peer
contents Accurate single cell detection in brightfield microscopy is crucial for biological research, yet data scarcity and annotation bottlenecks limit the progress of deep learning methods. We investigate the use of unconditional models to generate synthetic brightfield microscopy images and evaluate their impact on object detection performance. A U-Net based diffusion model was trained and used to create datasets with varying ratios of synthetic and real images. Experiments with YOLOv8, YOLOv9 and RT-DETR reveal that training with synthetic data can achieve improved detection accuracies (at minimal costs). A human expert survey demonstrates the high realism of generated images, with experts not capable to distinguish them from real microscopy images (accuracy 50%). Our findings suggest that diffusion-based synthetic data generation is a promising avenue for augmenting real datasets in microscopy image analysis, reducing the reliance on extensive manual annotation and potentially improving the robustness of cell detection models.
format Preprint
id arxiv_https___arxiv_org_abs_2512_00078
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Diffusion-Based Synthetic Brightfield Microscopy Images for Enhanced Single Cell Detection
da Graca, Mario de Jesus
Dahlkemper, Jörg
Stelldinger, Peer
Computer Vision and Pattern Recognition
Artificial Intelligence
I.2; I.4; J.3
Accurate single cell detection in brightfield microscopy is crucial for biological research, yet data scarcity and annotation bottlenecks limit the progress of deep learning methods. We investigate the use of unconditional models to generate synthetic brightfield microscopy images and evaluate their impact on object detection performance. A U-Net based diffusion model was trained and used to create datasets with varying ratios of synthetic and real images. Experiments with YOLOv8, YOLOv9 and RT-DETR reveal that training with synthetic data can achieve improved detection accuracies (at minimal costs). A human expert survey demonstrates the high realism of generated images, with experts not capable to distinguish them from real microscopy images (accuracy 50%). Our findings suggest that diffusion-based synthetic data generation is a promising avenue for augmenting real datasets in microscopy image analysis, reducing the reliance on extensive manual annotation and potentially improving the robustness of cell detection models.
title Diffusion-Based Synthetic Brightfield Microscopy Images for Enhanced Single Cell Detection
topic Computer Vision and Pattern Recognition
Artificial Intelligence
I.2; I.4; J.3
url https://arxiv.org/abs/2512.00078