Saved in:
Bibliographic Details
Main Authors: Li, Yuheng, Hu, Mingzhe, Qiu, Richard L. J., Thor, Maria, Williams, Andre, Marshall, Deborah, Yang, Xiaofeng
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2503.14304
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913743701540864
author Li, Yuheng
Hu, Mingzhe
Qiu, Richard L. J.
Thor, Maria
Williams, Andre
Marshall, Deborah
Yang, Xiaofeng
author_facet Li, Yuheng
Hu, Mingzhe
Qiu, Richard L. J.
Thor, Maria
Williams, Andre
Marshall, Deborah
Yang, Xiaofeng
contents Deep learning-based segmentation of genito-pelvic structures in MRI and CT is crucial for applications such as radiation therapy, surgical planning, and disease diagnosis. However, existing segmentation models often struggle with generalizability across imaging modalities, and anatomical variations. In this work, we propose RoMedFormer, a rotary-embedding transformer-based foundation model designed for 3D female genito-pelvic structure segmentation in both MRI and CT. RoMedFormer leverages self-supervised learning and rotary positional embeddings to enhance spatial feature representation and capture long-range dependencies in 3D medical data. We pre-train our model using a diverse dataset of 3D MRI and CT scans and fine-tune it for downstream segmentation tasks. Experimental results demonstrate that RoMedFormer achieves superior performance segmenting genito-pelvic organs. Our findings highlight the potential of transformer-based architectures in medical image segmentation and pave the way for more transferable segmentation frameworks.
format Preprint
id arxiv_https___arxiv_org_abs_2503_14304
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RoMedFormer: A Rotary-Embedding Transformer Foundation Model for 3D Genito-Pelvic Structure Segmentation in MRI and CT
Li, Yuheng
Hu, Mingzhe
Qiu, Richard L. J.
Thor, Maria
Williams, Andre
Marshall, Deborah
Yang, Xiaofeng
Image and Video Processing
Computer Vision and Pattern Recognition
Deep learning-based segmentation of genito-pelvic structures in MRI and CT is crucial for applications such as radiation therapy, surgical planning, and disease diagnosis. However, existing segmentation models often struggle with generalizability across imaging modalities, and anatomical variations. In this work, we propose RoMedFormer, a rotary-embedding transformer-based foundation model designed for 3D female genito-pelvic structure segmentation in both MRI and CT. RoMedFormer leverages self-supervised learning and rotary positional embeddings to enhance spatial feature representation and capture long-range dependencies in 3D medical data. We pre-train our model using a diverse dataset of 3D MRI and CT scans and fine-tune it for downstream segmentation tasks. Experimental results demonstrate that RoMedFormer achieves superior performance segmenting genito-pelvic organs. Our findings highlight the potential of transformer-based architectures in medical image segmentation and pave the way for more transferable segmentation frameworks.
title RoMedFormer: A Rotary-Embedding Transformer Foundation Model for 3D Genito-Pelvic Structure Segmentation in MRI and CT
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.14304