Deep Ensembling with Multimodal Image Fusion for Efficient Classification of Lung Cancer

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Pal, Surochita, Mitra, Sushmita
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913673751035904
author Pal, Surochita
Mitra, Sushmita
author_facet Pal, Surochita
Mitra, Sushmita
contents This study focuses on the classification of cancerous and healthy slices from multimodal lung images. The data used in the research comprises Computed Tomography (CT) and Positron Emission Tomography (PET) images. The proposed strategy achieves the fusion of PET and CT images by utilizing Principal Component Analysis (PCA) and an Autoencoder. Subsequently, a new ensemble-based classifier developed, Deep Ensembled Multimodal Fusion (DEMF), employing majority voting to classify the sample images under examination. Gradient-weighted Class Activation Mapping (Grad-CAM) employed to visualize the classification accuracy of cancer-affected images. Given the limited sample size, a random image augmentation strategy employed during the training phase. The DEMF network helps mitigate the challenges of scarce data in computer-aided medical image analysis. The proposed network compared with state-of-the-art networks across three publicly available datasets. The network outperforms others based on the metrics - Accuracy, F1-Score, Precision, and Recall. The investigation results highlight the effectiveness of the proposed network.
format Preprint
id arxiv_https___arxiv_org_abs_2502_00078
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Deep Ensembling with Multimodal Image Fusion for Efficient Classification of Lung Cancer
Pal, Surochita
Mitra, Sushmita
Image and Video Processing
Computer Vision and Pattern Recognition
This study focuses on the classification of cancerous and healthy slices from multimodal lung images. The data used in the research comprises Computed Tomography (CT) and Positron Emission Tomography (PET) images. The proposed strategy achieves the fusion of PET and CT images by utilizing Principal Component Analysis (PCA) and an Autoencoder. Subsequently, a new ensemble-based classifier developed, Deep Ensembled Multimodal Fusion (DEMF), employing majority voting to classify the sample images under examination. Gradient-weighted Class Activation Mapping (Grad-CAM) employed to visualize the classification accuracy of cancer-affected images. Given the limited sample size, a random image augmentation strategy employed during the training phase. The DEMF network helps mitigate the challenges of scarce data in computer-aided medical image analysis. The proposed network compared with state-of-the-art networks across three publicly available datasets. The network outperforms others based on the metrics - Accuracy, F1-Score, Precision, and Recall. The investigation results highlight the effectiveness of the proposed network.
title Deep Ensembling with Multimodal Image Fusion for Efficient Classification of Lung Cancer
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.00078