Multi-modal Medical Image Fusion For Non-Small Cell Lung Cancer Classification

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Hassan, Salma, Hammadi, Hamad Al, Mohammed, Ibrahim, Khan, Muhammad Haris
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929529239371776
author Hassan, Salma
Hammadi, Hamad Al
Mohammed, Ibrahim
Khan, Muhammad Haris
author_facet Hassan, Salma
Hammadi, Hamad Al
Mohammed, Ibrahim
Khan, Muhammad Haris
contents The early detection and nuanced subtype classification of non-small cell lung cancer (NSCLC), a predominant cause of cancer mortality worldwide, is a critical and complex issue. In this paper, we introduce an innovative integration of multi-modal data, synthesizing fused medical imaging (CT and PET scans) with clinical health records and genomic data. This unique fusion methodology leverages advanced machine learning models, notably MedClip and BEiT, for sophisticated image feature extraction, setting a new standard in computational oncology. Our research surpasses existing approaches, as evidenced by a substantial enhancement in NSCLC detection and classification precision. The results showcase notable improvements across key performance metrics, including accuracy, precision, recall, and F1-score. Specifically, our leading multi-modal classifier model records an impressive accuracy of 94.04%. We believe that our approach has the potential to transform NSCLC diagnostics, facilitating earlier detection and more effective treatment planning and, ultimately, leading to superior patient outcomes in lung cancer care.
format Preprint
id arxiv_https___arxiv_org_abs_2409_18715
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multi-modal Medical Image Fusion For Non-Small Cell Lung Cancer Classification
Hassan, Salma
Hammadi, Hamad Al
Mohammed, Ibrahim
Khan, Muhammad Haris
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
The early detection and nuanced subtype classification of non-small cell lung cancer (NSCLC), a predominant cause of cancer mortality worldwide, is a critical and complex issue. In this paper, we introduce an innovative integration of multi-modal data, synthesizing fused medical imaging (CT and PET scans) with clinical health records and genomic data. This unique fusion methodology leverages advanced machine learning models, notably MedClip and BEiT, for sophisticated image feature extraction, setting a new standard in computational oncology. Our research surpasses existing approaches, as evidenced by a substantial enhancement in NSCLC detection and classification precision. The results showcase notable improvements across key performance metrics, including accuracy, precision, recall, and F1-score. Specifically, our leading multi-modal classifier model records an impressive accuracy of 94.04%. We believe that our approach has the potential to transform NSCLC diagnostics, facilitating earlier detection and more effective treatment planning and, ultimately, leading to superior patient outcomes in lung cancer care.
title Multi-modal Medical Image Fusion For Non-Small Cell Lung Cancer Classification
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.18715