Polyp-SES: Automatic Polyp Segmentation with Self-Enriched Semantic Model

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Nguyen, Quang Vinh, Vo, Thanh Hoang Son, Kang, Sae-Ryung, Kim, Soo-Hyung
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909332891762688
author Nguyen, Quang Vinh
Vo, Thanh Hoang Son
Kang, Sae-Ryung
Kim, Soo-Hyung
author_facet Nguyen, Quang Vinh
Vo, Thanh Hoang Son
Kang, Sae-Ryung
Kim, Soo-Hyung
contents Automatic polyp segmentation is crucial for effective diagnosis and treatment in colonoscopy images. Traditional methods encounter significant challenges in accurately delineating polyps due to limitations in feature representation and the handling of variability in polyp appearance. Deep learning techniques, including CNN and Transformer-based methods, have been explored to improve polyp segmentation accuracy. However, existing approaches often neglect additional semantics, restricting their ability to acquire adequate contexts of polyps in colonoscopy images. In this paper, we propose an innovative method named ``Automatic Polyp Segmentation with Self-Enriched Semantic Model'' to address these limitations. First, we extract a sequence of features from an input image and decode high-level features to generate an initial segmentation mask. Using the proposed self-enriched semantic module, we query potential semantics and augment deep features with additional semantics, thereby aiding the model in understanding context more effectively. Extensive experiments show superior segmentation performance of the proposed method against state-of-the-art polyp segmentation baselines across five polyp benchmarks in both superior learning and generalization capabilities.
format Preprint
id arxiv_https___arxiv_org_abs_2410_01210
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Polyp-SES: Automatic Polyp Segmentation with Self-Enriched Semantic Model
Nguyen, Quang Vinh
Vo, Thanh Hoang Son
Kang, Sae-Ryung
Kim, Soo-Hyung
Computer Vision and Pattern Recognition
Artificial Intelligence
I.5.4; I.2.1; I.4.6; J.3
Automatic polyp segmentation is crucial for effective diagnosis and treatment in colonoscopy images. Traditional methods encounter significant challenges in accurately delineating polyps due to limitations in feature representation and the handling of variability in polyp appearance. Deep learning techniques, including CNN and Transformer-based methods, have been explored to improve polyp segmentation accuracy. However, existing approaches often neglect additional semantics, restricting their ability to acquire adequate contexts of polyps in colonoscopy images. In this paper, we propose an innovative method named ``Automatic Polyp Segmentation with Self-Enriched Semantic Model'' to address these limitations. First, we extract a sequence of features from an input image and decode high-level features to generate an initial segmentation mask. Using the proposed self-enriched semantic module, we query potential semantics and augment deep features with additional semantics, thereby aiding the model in understanding context more effectively. Extensive experiments show superior segmentation performance of the proposed method against state-of-the-art polyp segmentation baselines across five polyp benchmarks in both superior learning and generalization capabilities.
title Polyp-SES: Automatic Polyp Segmentation with Self-Enriched Semantic Model
topic Computer Vision and Pattern Recognition
Artificial Intelligence
I.5.4; I.2.1; I.4.6; J.3
url https://arxiv.org/abs/2410.01210