On generalisability of segment anything model for nuclear instance segmentation in histology images

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Xu, Kesi, Goetz, Lea, Rajpoot, Nasir
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913209309462528
author Xu, Kesi
Goetz, Lea
Rajpoot, Nasir
author_facet Xu, Kesi
Goetz, Lea
Rajpoot, Nasir
contents Pre-trained on a large and diverse dataset, the segment anything model (SAM) is the first promptable foundation model in computer vision aiming at object segmentation tasks. In this work, we evaluate SAM for the task of nuclear instance segmentation performance with zero-shot learning and finetuning. We compare SAM with other representative methods in nuclear instance segmentation, especially in the context of model generalisability. To achieve automatic nuclear instance segmentation, we propose using a nuclei detection model to provide bounding boxes or central points of nu-clei as visual prompts for SAM in generating nuclear instance masks from histology images.
format Preprint
id arxiv_https___arxiv_org_abs_2401_14248
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On generalisability of segment anything model for nuclear instance segmentation in histology images
Xu, Kesi
Goetz, Lea
Rajpoot, Nasir
Image and Video Processing
Computer Vision and Pattern Recognition
Pre-trained on a large and diverse dataset, the segment anything model (SAM) is the first promptable foundation model in computer vision aiming at object segmentation tasks. In this work, we evaluate SAM for the task of nuclear instance segmentation performance with zero-shot learning and finetuning. We compare SAM with other representative methods in nuclear instance segmentation, especially in the context of model generalisability. To achieve automatic nuclear instance segmentation, we propose using a nuclei detection model to provide bounding boxes or central points of nu-clei as visual prompts for SAM in generating nuclear instance masks from histology images.
title On generalisability of segment anything model for nuclear instance segmentation in histology images
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2401.14248