Saved in:
Bibliographic Details
Main Authors: Zheng, Zhou, Hayashi, Yuichiro, Oda, Masahiro, Kitasaka, Takayuki, Mori, Kensaku
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.08509
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909345342554112
author Zheng, Zhou
Hayashi, Yuichiro
Oda, Masahiro
Kitasaka, Takayuki
Mori, Kensaku
author_facet Zheng, Zhou
Hayashi, Yuichiro
Oda, Masahiro
Kitasaka, Takayuki
Mori, Kensaku
contents In this paper, we study weakly-supervised laparoscopic image segmentation with sparse annotations. We introduce a novel Bayesian deep learning approach designed to enhance both the accuracy and interpretability of the model's segmentation, founded upon a comprehensive Bayesian framework, ensuring a robust and theoretically validated method. Our approach diverges from conventional methods that directly train using observed images and their corresponding weak annotations. Instead, we estimate the joint distribution of both images and labels given the acquired data. This facilitates the sampling of images and their high-quality pseudo-labels, enabling the training of a generalizable segmentation model. Each component of our model is expressed through probabilistic formulations, providing a coherent and interpretable structure. This probabilistic nature benefits accurate and practical learning from sparse annotations and equips our model with the ability to quantify uncertainty. Extensive evaluations with two public laparoscopic datasets demonstrated the efficacy of our method, which consistently outperformed existing methods. Furthermore, our method was adapted for scribble-supervised cardiac multi-structure segmentation, presenting competitive performance compared to previous methods. The code is available at https://github.com/MoriLabNU/Bayesian_WSS.
format Preprint
id arxiv_https___arxiv_org_abs_2410_08509
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Bayesian Approach to Weakly-supervised Laparoscopic Image Segmentation
Zheng, Zhou
Hayashi, Yuichiro
Oda, Masahiro
Kitasaka, Takayuki
Mori, Kensaku
Computer Vision and Pattern Recognition
In this paper, we study weakly-supervised laparoscopic image segmentation with sparse annotations. We introduce a novel Bayesian deep learning approach designed to enhance both the accuracy and interpretability of the model's segmentation, founded upon a comprehensive Bayesian framework, ensuring a robust and theoretically validated method. Our approach diverges from conventional methods that directly train using observed images and their corresponding weak annotations. Instead, we estimate the joint distribution of both images and labels given the acquired data. This facilitates the sampling of images and their high-quality pseudo-labels, enabling the training of a generalizable segmentation model. Each component of our model is expressed through probabilistic formulations, providing a coherent and interpretable structure. This probabilistic nature benefits accurate and practical learning from sparse annotations and equips our model with the ability to quantify uncertainty. Extensive evaluations with two public laparoscopic datasets demonstrated the efficacy of our method, which consistently outperformed existing methods. Furthermore, our method was adapted for scribble-supervised cardiac multi-structure segmentation, presenting competitive performance compared to previous methods. The code is available at https://github.com/MoriLabNU/Bayesian_WSS.
title A Bayesian Approach to Weakly-supervised Laparoscopic Image Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.08509