Tumor segmentation on whole slide images: training or prompting?

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wu, Huaqian, Brémond-Martin, Clara, Bouaou, Kévin, Clouchoux, Cédric
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911781368102912
author Wu, Huaqian
Brémond-Martin, Clara
Bouaou, Kévin
Clouchoux, Cédric
author_facet Wu, Huaqian
Brémond-Martin, Clara
Bouaou, Kévin
Clouchoux, Cédric
contents Tumor segmentation stands as a pivotal task in cancer diagnosis. Given the immense dimensions of whole slide images (WSI) in histology, deep learning approaches for WSI classification mainly operate at patch-wise or superpixel-wise level. However, these solutions often struggle to capture global WSI information and cannot directly generate the binary mask. Downsampling the WSI and performing semantic segmentation is another possible approach. While this method offers computational efficiency, it necessitates a large amount of annotated data since resolution reduction may lead to information loss. Visual prompting is a novel paradigm that allows the model to perform new tasks by making subtle modifications to the input space, rather than adapting the model itself. Such approach has demonstrated promising results on many computer vision tasks. In this paper, we show the efficacy of visual prompting in the context of tumor segmentation for three distinct organs. In comparison to classical methods trained for this specific task, our findings reveal that, with appropriate prompt examples, visual prompting can achieve comparable or better performance without extensive fine-tuning.
format Preprint
id arxiv_https___arxiv_org_abs_2402_13932
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Tumor segmentation on whole slide images: training or prompting?
Wu, Huaqian
Brémond-Martin, Clara
Bouaou, Kévin
Clouchoux, Cédric
Computer Vision and Pattern Recognition
Tumor segmentation stands as a pivotal task in cancer diagnosis. Given the immense dimensions of whole slide images (WSI) in histology, deep learning approaches for WSI classification mainly operate at patch-wise or superpixel-wise level. However, these solutions often struggle to capture global WSI information and cannot directly generate the binary mask. Downsampling the WSI and performing semantic segmentation is another possible approach. While this method offers computational efficiency, it necessitates a large amount of annotated data since resolution reduction may lead to information loss. Visual prompting is a novel paradigm that allows the model to perform new tasks by making subtle modifications to the input space, rather than adapting the model itself. Such approach has demonstrated promising results on many computer vision tasks. In this paper, we show the efficacy of visual prompting in the context of tumor segmentation for three distinct organs. In comparison to classical methods trained for this specific task, our findings reveal that, with appropriate prompt examples, visual prompting can achieve comparable or better performance without extensive fine-tuning.
title Tumor segmentation on whole slide images: training or prompting?
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.13932