Scribble-Based Interactive Segmentation of Medical Hyperspectral Images

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wang, Zhonghao, Wang, Junwen, Budd, Charlie, MacCormac, Oscar, Shapey, Jonathan, Vercauteren, Tom
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929449744728064
author Wang, Zhonghao
Wang, Junwen
Budd, Charlie
MacCormac, Oscar
Shapey, Jonathan
Vercauteren, Tom
author_facet Wang, Zhonghao
Wang, Junwen
Budd, Charlie
MacCormac, Oscar
Shapey, Jonathan
Vercauteren, Tom
contents Hyperspectral imaging (HSI) is an advanced medical imaging modality that captures optical data across a broad spectral range, providing novel insights into the biochemical composition of tissues. HSI may enable precise differentiation between various tissue types and pathologies, making it particularly valuable for tumour detection, tissue classification, and disease diagnosis. Deep learning-based segmentation methods have shown considerable advancements, offering automated and accurate results. However, these methods face challenges with HSI datasets due to limited annotated data and discrepancies from hardware and acquisition techniques~\cite{clancy2020surgical,studier2023heiporspectral}. Variability in clinical protocols also leads to different definitions of structure boundaries. Interactive segmentation methods, utilizing user knowledge and clinical insights, can overcome these issues and achieve precise segmentation results \cite{zhao2013overview}. This work introduces a scribble-based interactive segmentation framework for medical hyperspectral images. The proposed method utilizes deep learning for feature extraction and a geodesic distance map generated from user-provided scribbles to obtain the segmentation results. The experiment results show that utilising the geodesic distance maps based on deep learning-extracted features achieved better segmentation results than geodesic distance maps directly generated from hyperspectral images, reconstructed RGB images, or Euclidean distance maps.
format Preprint
id arxiv_https___arxiv_org_abs_2408_02708
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Scribble-Based Interactive Segmentation of Medical Hyperspectral Images
Wang, Zhonghao
Wang, Junwen
Budd, Charlie
MacCormac, Oscar
Shapey, Jonathan
Vercauteren, Tom
Image and Video Processing
Computer Vision and Pattern Recognition
Hyperspectral imaging (HSI) is an advanced medical imaging modality that captures optical data across a broad spectral range, providing novel insights into the biochemical composition of tissues. HSI may enable precise differentiation between various tissue types and pathologies, making it particularly valuable for tumour detection, tissue classification, and disease diagnosis. Deep learning-based segmentation methods have shown considerable advancements, offering automated and accurate results. However, these methods face challenges with HSI datasets due to limited annotated data and discrepancies from hardware and acquisition techniques~\cite{clancy2020surgical,studier2023heiporspectral}. Variability in clinical protocols also leads to different definitions of structure boundaries. Interactive segmentation methods, utilizing user knowledge and clinical insights, can overcome these issues and achieve precise segmentation results \cite{zhao2013overview}. This work introduces a scribble-based interactive segmentation framework for medical hyperspectral images. The proposed method utilizes deep learning for feature extraction and a geodesic distance map generated from user-provided scribbles to obtain the segmentation results. The experiment results show that utilising the geodesic distance maps based on deep learning-extracted features achieved better segmentation results than geodesic distance maps directly generated from hyperspectral images, reconstructed RGB images, or Euclidean distance maps.
title Scribble-Based Interactive Segmentation of Medical Hyperspectral Images
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.02708