ODFormer: Semantic Fundus Image Segmentation Using Transformer for Optic Nerve Head Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Jiayi, Mao, Yi-An, Ma, Xiaoyu, Guo, Sicen, Shao, Yuting, Lv, Xiao, Han, Wenting, Christopher, Mark, Zangwill, Linda M., Bi, Yanlong, Fan, Rui
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914818696413184
author Wang, Jiayi
Mao, Yi-An
Ma, Xiaoyu
Guo, Sicen
Shao, Yuting
Lv, Xiao
Han, Wenting
Christopher, Mark
Zangwill, Linda M.
Bi, Yanlong
Fan, Rui
author_facet Wang, Jiayi
Mao, Yi-An
Ma, Xiaoyu
Guo, Sicen
Shao, Yuting
Lv, Xiao
Han, Wenting
Christopher, Mark
Zangwill, Linda M.
Bi, Yanlong
Fan, Rui
contents Optic nerve head (ONH) detection has been a crucial area of study in ophthalmology for years. However, the significant discrepancy between fundus image datasets, each generated using a single type of fundus camera, poses challenges to the generalizability of ONH detection approaches developed based on semantic segmentation networks. Despite the numerous recent advancements in general-purpose semantic segmentation methods using convolutional neural networks (CNNs) and Transformers, there is currently a lack of benchmarks for these state-of-the-art (SoTA) networks specifically trained for ONH detection. Therefore, in this article, we make contributions from three key aspects: network design, the publication of a dataset, and the establishment of a comprehensive benchmark. Our newly developed ONH detection network, referred to as ODFormer, is based upon the Swin Transformer architecture and incorporates two novel components: a multi-scale context aggregator and a lightweight bidirectional feature recalibrator. Our published large-scale dataset, known as TongjiU-DROD, provides multi-resolution fundus images for each participant, captured using two distinct types of cameras. Our established benchmark involves three datasets: DRIONS-DB, DRISHTI-GS1, and TongjiU-DROD, created by researchers from different countries and containing fundus images captured from participants of diverse races and ages. Extensive experimental results demonstrate that our proposed ODFormer outperforms other state-of-the-art (SoTA) networks in terms of performance and generalizability. Our dataset and source code are publicly available at mias.group/ODFormer.
format Preprint
id arxiv_https___arxiv_org_abs_2405_09552
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ODFormer: Semantic Fundus Image Segmentation Using Transformer for Optic Nerve Head Detection
Wang, Jiayi
Mao, Yi-An
Ma, Xiaoyu
Guo, Sicen
Shao, Yuting
Lv, Xiao
Han, Wenting
Christopher, Mark
Zangwill, Linda M.
Bi, Yanlong
Fan, Rui
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Optic nerve head (ONH) detection has been a crucial area of study in ophthalmology for years. However, the significant discrepancy between fundus image datasets, each generated using a single type of fundus camera, poses challenges to the generalizability of ONH detection approaches developed based on semantic segmentation networks. Despite the numerous recent advancements in general-purpose semantic segmentation methods using convolutional neural networks (CNNs) and Transformers, there is currently a lack of benchmarks for these state-of-the-art (SoTA) networks specifically trained for ONH detection. Therefore, in this article, we make contributions from three key aspects: network design, the publication of a dataset, and the establishment of a comprehensive benchmark. Our newly developed ONH detection network, referred to as ODFormer, is based upon the Swin Transformer architecture and incorporates two novel components: a multi-scale context aggregator and a lightweight bidirectional feature recalibrator. Our published large-scale dataset, known as TongjiU-DROD, provides multi-resolution fundus images for each participant, captured using two distinct types of cameras. Our established benchmark involves three datasets: DRIONS-DB, DRISHTI-GS1, and TongjiU-DROD, created by researchers from different countries and containing fundus images captured from participants of diverse races and ages. Extensive experimental results demonstrate that our proposed ODFormer outperforms other state-of-the-art (SoTA) networks in terms of performance and generalizability. Our dataset and source code are publicly available at mias.group/ODFormer.
title ODFormer: Semantic Fundus Image Segmentation Using Transformer for Optic Nerve Head Detection
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.09552