PathSegDiff: Pathology Segmentation using Diffusion model representations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Danisetty, Sachin Kumar, Graikos, Alexandros, Yellapragada, Srikar, Samaras, Dimitris
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915234679095296
author Danisetty, Sachin Kumar
Graikos, Alexandros
Yellapragada, Srikar
Samaras, Dimitris
author_facet Danisetty, Sachin Kumar
Graikos, Alexandros
Yellapragada, Srikar
Samaras, Dimitris
contents Image segmentation is crucial in many computational pathology pipelines, including accurate disease diagnosis, subtyping, outcome, and survivability prediction. The common approach for training a segmentation model relies on a pre-trained feature extractor and a dataset of paired image and mask annotations. These are used to train a lightweight prediction model that translates features into per-pixel classes. The choice of the feature extractor is central to the performance of the final segmentation model, and recent literature has focused on finding tasks to pre-train the feature extractor. In this paper, we propose PathSegDiff, a novel approach for histopathology image segmentation that leverages Latent Diffusion Models (LDMs) as pre-trained featured extractors. Our method utilizes a pathology-specific LDM, guided by a self-supervised encoder, to extract rich semantic information from H\&E stained histopathology images. We employ a simple, fully convolutional network to process the features extracted from the LDM and generate segmentation masks. Our experiments demonstrate significant improvements over traditional methods on the BCSS and GlaS datasets, highlighting the effectiveness of domain-specific diffusion pre-training in capturing intricate tissue structures and enhancing segmentation accuracy in histopathology images.
format Preprint
id arxiv_https___arxiv_org_abs_2504_06950
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PathSegDiff: Pathology Segmentation using Diffusion model representations
Danisetty, Sachin Kumar
Graikos, Alexandros
Yellapragada, Srikar
Samaras, Dimitris
Computer Vision and Pattern Recognition
Image segmentation is crucial in many computational pathology pipelines, including accurate disease diagnosis, subtyping, outcome, and survivability prediction. The common approach for training a segmentation model relies on a pre-trained feature extractor and a dataset of paired image and mask annotations. These are used to train a lightweight prediction model that translates features into per-pixel classes. The choice of the feature extractor is central to the performance of the final segmentation model, and recent literature has focused on finding tasks to pre-train the feature extractor. In this paper, we propose PathSegDiff, a novel approach for histopathology image segmentation that leverages Latent Diffusion Models (LDMs) as pre-trained featured extractors. Our method utilizes a pathology-specific LDM, guided by a self-supervised encoder, to extract rich semantic information from H\&E stained histopathology images. We employ a simple, fully convolutional network to process the features extracted from the LDM and generate segmentation masks. Our experiments demonstrate significant improvements over traditional methods on the BCSS and GlaS datasets, highlighting the effectiveness of domain-specific diffusion pre-training in capturing intricate tissue structures and enhancing segmentation accuracy in histopathology images.
title PathSegDiff: Pathology Segmentation using Diffusion model representations
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.06950