F2PASeg: Feature Fusion for Pituitary Anatomy Segmentation in Endoscopic Surgery

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chen, Lumin, Wu, Zhiying, Lei, Tianye, Bai, Xuexue, Feng, Ming, Wang, Yuxi, Meng, Gaofeng, Lei, Zhen, Liu, Hongbin
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911095949623296
author Chen, Lumin
Wu, Zhiying
Lei, Tianye
Bai, Xuexue
Feng, Ming
Wang, Yuxi
Meng, Gaofeng
Lei, Zhen
Liu, Hongbin
author_facet Chen, Lumin
Wu, Zhiying
Lei, Tianye
Bai, Xuexue
Feng, Ming
Wang, Yuxi
Meng, Gaofeng
Lei, Zhen
Liu, Hongbin
contents Pituitary tumors often cause deformation or encapsulation of adjacent vital structures. Anatomical structure segmentation can provide surgeons with early warnings of regions that pose surgical risks, thereby enhancing the safety of pituitary surgery. However, pixel-level annotated video stream datasets for pituitary surgeries are extremely rare. To address this challenge, we introduce a new dataset for Pituitary Anatomy Segmentation (PAS). PAS comprises 7,845 time-coherent images extracted from 120 videos. To mitigate class imbalance, we apply data augmentation techniques that simulate the presence of surgical instruments in the training data. One major challenge in pituitary anatomy segmentation is the inconsistency in feature representation due to occlusions, camera motion, and surgical bleeding. By incorporating a Feature Fusion module, F2PASeg is proposed to refine anatomical structure segmentation by leveraging both high-resolution image features and deep semantic embeddings, enhancing robustness against intraoperative variations. Experimental results demonstrate that F2PASeg consistently segments critical anatomical structures in real time, providing a reliable solution for intraoperative pituitary surgery planning. Code: https://github.com/paulili08/F2PASeg.
format Preprint
id arxiv_https___arxiv_org_abs_2508_05465
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle F2PASeg: Feature Fusion for Pituitary Anatomy Segmentation in Endoscopic Surgery
Chen, Lumin
Wu, Zhiying
Lei, Tianye
Bai, Xuexue
Feng, Ming
Wang, Yuxi
Meng, Gaofeng
Lei, Zhen
Liu, Hongbin
Computer Vision and Pattern Recognition
Systems and Control
Image and Video Processing
Pituitary tumors often cause deformation or encapsulation of adjacent vital structures. Anatomical structure segmentation can provide surgeons with early warnings of regions that pose surgical risks, thereby enhancing the safety of pituitary surgery. However, pixel-level annotated video stream datasets for pituitary surgeries are extremely rare. To address this challenge, we introduce a new dataset for Pituitary Anatomy Segmentation (PAS). PAS comprises 7,845 time-coherent images extracted from 120 videos. To mitigate class imbalance, we apply data augmentation techniques that simulate the presence of surgical instruments in the training data. One major challenge in pituitary anatomy segmentation is the inconsistency in feature representation due to occlusions, camera motion, and surgical bleeding. By incorporating a Feature Fusion module, F2PASeg is proposed to refine anatomical structure segmentation by leveraging both high-resolution image features and deep semantic embeddings, enhancing robustness against intraoperative variations. Experimental results demonstrate that F2PASeg consistently segments critical anatomical structures in real time, providing a reliable solution for intraoperative pituitary surgery planning. Code: https://github.com/paulili08/F2PASeg.
title F2PASeg: Feature Fusion for Pituitary Anatomy Segmentation in Endoscopic Surgery
topic Computer Vision and Pattern Recognition
Systems and Control
Image and Video Processing
url https://arxiv.org/abs/2508.05465