DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wu, Zhuoyu, Ou, Wenhui, Zhang, Lexi, Tan, Pei-Sze, Wu, Dongjun, Zhao, Junhe, Fang, Wenqi, Phan, Raphaël C. -W.
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916017864704000
author Wu, Zhuoyu
Ou, Wenhui
Zhang, Lexi
Tan, Pei-Sze
Wu, Dongjun
Zhao, Junhe
Fang, Wenqi
Phan, Raphaël C. -W.
author_facet Wu, Zhuoyu
Ou, Wenhui
Zhang, Lexi
Tan, Pei-Sze
Wu, Dongjun
Zhao, Junhe
Fang, Wenqi
Phan, Raphaël C. -W.
contents Accurate polyp segmentation in colonoscopy is essential for early colorectal cancer detection, yet real-world clinical environments pose persistent challenges such as motion blur, specular reflections, and illumination instability. Most existing methods are optimized on clean benchmark images and suffer noticeable performance degradation when deployed in authentic surgical scenarios. We propose DepthPolyp, a lightweight and robust segmentation framework based on pseudo-depth-guided multi-task learning and efficient feature modulation. The architecture combines hierarchical Ghost factorization for compact feature generation, Interleaved Shuffle Fusion for low-cost cross-scale interaction, and Dynamic Group Gating for adaptive group-wise feature weighting. Extensive experiments demonstrate that DepthPolyp achieves strong cross-dataset generalization when trained on degraded data and evaluated on both clean and noisy target domains, consistently outperforming lightweight baselines and remaining competitive with substantially larger models. In real surgical video evaluation on PolypGen, DepthPolyp achieves better segmentation performance than models up to $20\times$ larger while preserving real-time inference speed. With only 3.57M parameters and 0.86 GMACs, the proposed method runs at over 180 FPS on mobile devices, making it well suited for real-time deployment in resource-constrained clinical environments. Code and pretrained weights are available at: https://github.com/ReaganWu/DepthPolyp/
format Preprint
id arxiv_https___arxiv_org_abs_2605_16519
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy
Wu, Zhuoyu
Ou, Wenhui
Zhang, Lexi
Tan, Pei-Sze
Wu, Dongjun
Zhao, Junhe
Fang, Wenqi
Phan, Raphaël C. -W.
Computer Vision and Pattern Recognition
Signal Processing
Accurate polyp segmentation in colonoscopy is essential for early colorectal cancer detection, yet real-world clinical environments pose persistent challenges such as motion blur, specular reflections, and illumination instability. Most existing methods are optimized on clean benchmark images and suffer noticeable performance degradation when deployed in authentic surgical scenarios. We propose DepthPolyp, a lightweight and robust segmentation framework based on pseudo-depth-guided multi-task learning and efficient feature modulation. The architecture combines hierarchical Ghost factorization for compact feature generation, Interleaved Shuffle Fusion for low-cost cross-scale interaction, and Dynamic Group Gating for adaptive group-wise feature weighting. Extensive experiments demonstrate that DepthPolyp achieves strong cross-dataset generalization when trained on degraded data and evaluated on both clean and noisy target domains, consistently outperforming lightweight baselines and remaining competitive with substantially larger models. In real surgical video evaluation on PolypGen, DepthPolyp achieves better segmentation performance than models up to $20\times$ larger while preserving real-time inference speed. With only 3.57M parameters and 0.86 GMACs, the proposed method runs at over 180 FPS on mobile devices, making it well suited for real-time deployment in resource-constrained clinical environments. Code and pretrained weights are available at: https://github.com/ReaganWu/DepthPolyp/
title DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy
topic Computer Vision and Pattern Recognition
Signal Processing
url https://arxiv.org/abs/2605.16519