Enhancing Boundary Segmentation for Topological Accuracy with Skeleton-based Methods

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liu, Chuni, Ma, Boyuan, Ban, Xiaojuan, Xie, Yujie, Wang, Hao, Xue, Weihua, Ma, Jingchao, Xu, Ke
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916047700885504
author Liu, Chuni
Ma, Boyuan
Ban, Xiaojuan
Xie, Yujie
Wang, Hao
Xue, Weihua
Ma, Jingchao
Xu, Ke
author_facet Liu, Chuni
Ma, Boyuan
Ban, Xiaojuan
Xie, Yujie
Wang, Hao
Xue, Weihua
Ma, Jingchao
Xu, Ke
contents Topological consistency plays a crucial role in the task of boundary segmentation for reticular images, such as cell membrane segmentation in neuron electron microscopic images, grain boundary segmentation in material microscopic images and road segmentation in aerial images. In these fields, topological changes in segmentation results have a serious impact on the downstream tasks, which can even exceed the misalignment of the boundary itself. To enhance the topology accuracy in segmentation results, we propose the Skea-Topo Aware loss, which is a novel loss function that takes into account the shape of each object and topological significance of the pixels. It consists of two components. First, a skeleton-aware weighted loss improves the segmentation accuracy by better modeling the object geometry with skeletons. Second, a boundary rectified term effectively identifies and emphasizes topological critical pixels in the prediction errors using both foreground and background skeletons in the ground truth and predictions. Experiments prove that our method improves topological consistency by up to 7 points in VI compared to 13 state-of-art methods, based on objective and subjective assessments across three different boundary segmentation datasets. The code is available at https://github.com/clovermini/Skea_topo.
format Preprint
id arxiv_https___arxiv_org_abs_2404_18539
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Enhancing Boundary Segmentation for Topological Accuracy with Skeleton-based Methods
Liu, Chuni
Ma, Boyuan
Ban, Xiaojuan
Xie, Yujie
Wang, Hao
Xue, Weihua
Ma, Jingchao
Xu, Ke
Computer Vision and Pattern Recognition
Artificial Intelligence
Topological consistency plays a crucial role in the task of boundary segmentation for reticular images, such as cell membrane segmentation in neuron electron microscopic images, grain boundary segmentation in material microscopic images and road segmentation in aerial images. In these fields, topological changes in segmentation results have a serious impact on the downstream tasks, which can even exceed the misalignment of the boundary itself. To enhance the topology accuracy in segmentation results, we propose the Skea-Topo Aware loss, which is a novel loss function that takes into account the shape of each object and topological significance of the pixels. It consists of two components. First, a skeleton-aware weighted loss improves the segmentation accuracy by better modeling the object geometry with skeletons. Second, a boundary rectified term effectively identifies and emphasizes topological critical pixels in the prediction errors using both foreground and background skeletons in the ground truth and predictions. Experiments prove that our method improves topological consistency by up to 7 points in VI compared to 13 state-of-art methods, based on objective and subjective assessments across three different boundary segmentation datasets. The code is available at https://github.com/clovermini/Skea_topo.
title Enhancing Boundary Segmentation for Topological Accuracy with Skeleton-based Methods
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2404.18539