Saved in:
Bibliographic Details
Main Authors: Islam, Md. Touhidul, Chowdhury, Md. Abtahi Majeed, Hasan, Mahmudul, Quadir, Asif, Aktar, Lutfa
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.17788
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912047212527616
author Islam, Md. Touhidul
Chowdhury, Md. Abtahi Majeed
Hasan, Mahmudul
Quadir, Asif
Aktar, Lutfa
author_facet Islam, Md. Touhidul
Chowdhury, Md. Abtahi Majeed
Hasan, Mahmudul
Quadir, Asif
Aktar, Lutfa
contents Ophthalmic diseases represent a significant global health issue, necessitating the use of advanced precise diagnostic tools. Optical Coherence Tomography (OCT) imagery which offers high-resolution cross-sectional images of the retina has become a pivotal imaging modality in ophthalmology. Traditionally physicians have manually detected various diseases and biomarkers from such diagnostic imagery. In recent times, deep learning techniques have been extensively used for medical diagnostic tasks enabling fast and precise diagnosis. This paper presents a novel approach for ophthalmic biomarker detection using an ensemble of Convolutional Neural Network (CNN) and Vision Transformer. While CNNs are good for feature extraction within the local context of the image, transformers are known for their ability to extract features from the global context of the image. Using an ensemble of both techniques allows us to harness the best of both worlds. Our method has been implemented on the OLIVES dataset to detect 6 major biomarkers from the OCT images and shows significant improvement of the macro averaged F1 score on the dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2409_17788
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Ophthalmic Biomarker Detection with Parallel Prediction of Transformer and Convolutional Architecture
Islam, Md. Touhidul
Chowdhury, Md. Abtahi Majeed
Hasan, Mahmudul
Quadir, Asif
Aktar, Lutfa
Artificial Intelligence
Ophthalmic diseases represent a significant global health issue, necessitating the use of advanced precise diagnostic tools. Optical Coherence Tomography (OCT) imagery which offers high-resolution cross-sectional images of the retina has become a pivotal imaging modality in ophthalmology. Traditionally physicians have manually detected various diseases and biomarkers from such diagnostic imagery. In recent times, deep learning techniques have been extensively used for medical diagnostic tasks enabling fast and precise diagnosis. This paper presents a novel approach for ophthalmic biomarker detection using an ensemble of Convolutional Neural Network (CNN) and Vision Transformer. While CNNs are good for feature extraction within the local context of the image, transformers are known for their ability to extract features from the global context of the image. Using an ensemble of both techniques allows us to harness the best of both worlds. Our method has been implemented on the OLIVES dataset to detect 6 major biomarkers from the OCT images and shows significant improvement of the macro averaged F1 score on the dataset.
title Ophthalmic Biomarker Detection with Parallel Prediction of Transformer and Convolutional Architecture
topic Artificial Intelligence
url https://arxiv.org/abs/2409.17788