Endo-SemiS: Towards Robust Semi-Supervised Image Segmentation for Endoscopic Video

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Hao, Lu, Daiwei, Yao, Xing, Kavoussi, Nicholas, Oguz, Ipek
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908721536303104
author Li, Hao
Lu, Daiwei
Yao, Xing
Kavoussi, Nicholas
Oguz, Ipek
author_facet Li, Hao
Lu, Daiwei
Yao, Xing
Kavoussi, Nicholas
Oguz, Ipek
contents In this paper, we present Endo-SemiS, a semi-supervised segmentation framework for providing reliable segmentation of endoscopic video frames with limited annotation. EndoSemiS uses 4 strategies to improve performance by effectively utilizing all available data, particularly unlabeled data: (1) Cross-supervision between two individual networks that supervise each other; (2) Uncertainty-guided pseudo-labels from unlabeled data, which are generated by selecting high-confidence regions to improve their quality; (3) Joint pseudolabel supervision, which aggregates reliable pixels from the pseudo-labels of both networks to provide accurate supervision for unlabeled data; and (4) Mutual learning, where both networks learn from each other at the feature and image levels, reducing variance and guiding them toward a consistent solution. Additionally, a separate corrective network that utilizes spatiotemporal information from endoscopy video to improve segmentation performance. Endo-SemiS is evaluated on two clinical applications: kidney stone laser lithotomy from ureteroscopy and polyp screening from colonoscopy. Compared to state-of-the-art segmentation methods, Endo-SemiS substantially achieves superior results on both datasets with limited labeled data. The code is publicly available at https://github.com/MedICL-VU/Endo-SemiS
format Preprint
id arxiv_https___arxiv_org_abs_2512_16977
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Endo-SemiS: Towards Robust Semi-Supervised Image Segmentation for Endoscopic Video
Li, Hao
Lu, Daiwei
Yao, Xing
Kavoussi, Nicholas
Oguz, Ipek
Computer Vision and Pattern Recognition
In this paper, we present Endo-SemiS, a semi-supervised segmentation framework for providing reliable segmentation of endoscopic video frames with limited annotation. EndoSemiS uses 4 strategies to improve performance by effectively utilizing all available data, particularly unlabeled data: (1) Cross-supervision between two individual networks that supervise each other; (2) Uncertainty-guided pseudo-labels from unlabeled data, which are generated by selecting high-confidence regions to improve their quality; (3) Joint pseudolabel supervision, which aggregates reliable pixels from the pseudo-labels of both networks to provide accurate supervision for unlabeled data; and (4) Mutual learning, where both networks learn from each other at the feature and image levels, reducing variance and guiding them toward a consistent solution. Additionally, a separate corrective network that utilizes spatiotemporal information from endoscopy video to improve segmentation performance. Endo-SemiS is evaluated on two clinical applications: kidney stone laser lithotomy from ureteroscopy and polyp screening from colonoscopy. Compared to state-of-the-art segmentation methods, Endo-SemiS substantially achieves superior results on both datasets with limited labeled data. The code is publicly available at https://github.com/MedICL-VU/Endo-SemiS
title Endo-SemiS: Towards Robust Semi-Supervised Image Segmentation for Endoscopic Video
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.16977