Representing Topological Self-Similarity Using Fractal Feature Maps for Accurate Segmentation of Tubular Structures

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Huang, Jiaxing, Zhou, Yanfeng, Luo, Yaoru, Liu, Guole, Guo, Heng, Yang, Ge
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909263128952832
author Huang, Jiaxing
Zhou, Yanfeng
Luo, Yaoru
Liu, Guole
Guo, Heng
Yang, Ge
author_facet Huang, Jiaxing
Zhou, Yanfeng
Luo, Yaoru
Liu, Guole
Guo, Heng
Yang, Ge
contents Accurate segmentation of long and thin tubular structures is required in a wide variety of areas such as biology, medicine, and remote sensing. The complex topology and geometry of such structures often pose significant technical challenges. A fundamental property of such structures is their topological self-similarity, which can be quantified by fractal features such as fractal dimension (FD). In this study, we incorporate fractal features into a deep learning model by extending FD to the pixel-level using a sliding window technique. The resulting fractal feature maps (FFMs) are then incorporated as additional input to the model and additional weight in the loss function to enhance segmentation performance by utilizing the topological self-similarity. Moreover, we extend the U-Net architecture by incorporating an edge decoder and a skeleton decoder to improve boundary accuracy and skeletal continuity of segmentation, respectively. Extensive experiments on five tubular structure datasets validate the effectiveness and robustness of our approach. Furthermore, the integration of FFMs with other popular segmentation models such as HR-Net also yields performance enhancement, suggesting FFM can be incorporated as a plug-in module with different model architectures. Code and data are openly accessible at https://github.com/cbmi-group/FFM-Multi-Decoder-Network.
format Preprint
id arxiv_https___arxiv_org_abs_2407_14754
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Representing Topological Self-Similarity Using Fractal Feature Maps for Accurate Segmentation of Tubular Structures
Huang, Jiaxing
Zhou, Yanfeng
Luo, Yaoru
Liu, Guole
Guo, Heng
Yang, Ge
Image and Video Processing
Computer Vision and Pattern Recognition
Accurate segmentation of long and thin tubular structures is required in a wide variety of areas such as biology, medicine, and remote sensing. The complex topology and geometry of such structures often pose significant technical challenges. A fundamental property of such structures is their topological self-similarity, which can be quantified by fractal features such as fractal dimension (FD). In this study, we incorporate fractal features into a deep learning model by extending FD to the pixel-level using a sliding window technique. The resulting fractal feature maps (FFMs) are then incorporated as additional input to the model and additional weight in the loss function to enhance segmentation performance by utilizing the topological self-similarity. Moreover, we extend the U-Net architecture by incorporating an edge decoder and a skeleton decoder to improve boundary accuracy and skeletal continuity of segmentation, respectively. Extensive experiments on five tubular structure datasets validate the effectiveness and robustness of our approach. Furthermore, the integration of FFMs with other popular segmentation models such as HR-Net also yields performance enhancement, suggesting FFM can be incorporated as a plug-in module with different model architectures. Code and data are openly accessible at https://github.com/cbmi-group/FFM-Multi-Decoder-Network.
title Representing Topological Self-Similarity Using Fractal Feature Maps for Accurate Segmentation of Tubular Structures
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.14754