Saved in:
Bibliographic Details
Main Authors: Wang, Tong, Qi, Yaolei, Wang, Siwen, Razzak, Imran, Yang, Guanyu, Xie, Yutong
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.22821
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912928167362560
author Wang, Tong
Qi, Yaolei
Wang, Siwen
Razzak, Imran
Yang, Guanyu
Xie, Yutong
author_facet Wang, Tong
Qi, Yaolei
Wang, Siwen
Razzak, Imran
Yang, Guanyu
Xie, Yutong
contents Video polyp segmentation (VPS) is an important task in computer-aided colonoscopy, as it helps doctors accurately locate and track polyps during examinations. However, VPS remains challenging because polyps often look similar to surrounding mucosa, leading to weak semantic discrimination. In addition, large changes in polyp position and scale across video frames make stable and accurate segmentation difficult. To address these challenges, we propose a robust VPS framework named CMSA-Net. The proposed network introduces a Causal Multi-scale Aggregation (CMA) module to effectively gather semantic information from multiple historical frames at different scales. By using causal attention, CMA ensures that temporal feature propagation follows strict time order, which helps reduce noise and improve feature reliability. Furthermore, we design a Dynamic Multi-source Reference (DMR) strategy that adaptively selects informative and reliable reference frames based on semantic separability and prediction confidence. This strategy provides strong multi-frame guidance while keeping the model efficient for real-time inference. Extensive experiments on the SUN-SEG dataset demonstrate that CMSA-Net achieves state-of-the-art performance, offering a favorable balance between segmentation accuracy and real-time clinical applicability.
format Preprint
id arxiv_https___arxiv_org_abs_2602_22821
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CMSA-Net: Causal Multi-scale Aggregation with Adaptive Multi-source Reference for Video Polyp Segmentation
Wang, Tong
Qi, Yaolei
Wang, Siwen
Razzak, Imran
Yang, Guanyu
Xie, Yutong
Computer Vision and Pattern Recognition
Video polyp segmentation (VPS) is an important task in computer-aided colonoscopy, as it helps doctors accurately locate and track polyps during examinations. However, VPS remains challenging because polyps often look similar to surrounding mucosa, leading to weak semantic discrimination. In addition, large changes in polyp position and scale across video frames make stable and accurate segmentation difficult. To address these challenges, we propose a robust VPS framework named CMSA-Net. The proposed network introduces a Causal Multi-scale Aggregation (CMA) module to effectively gather semantic information from multiple historical frames at different scales. By using causal attention, CMA ensures that temporal feature propagation follows strict time order, which helps reduce noise and improve feature reliability. Furthermore, we design a Dynamic Multi-source Reference (DMR) strategy that adaptively selects informative and reliable reference frames based on semantic separability and prediction confidence. This strategy provides strong multi-frame guidance while keeping the model efficient for real-time inference. Extensive experiments on the SUN-SEG dataset demonstrate that CMSA-Net achieves state-of-the-art performance, offering a favorable balance between segmentation accuracy and real-time clinical applicability.
title CMSA-Net: Causal Multi-scale Aggregation with Adaptive Multi-source Reference for Video Polyp Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.22821