Optimizing Skin Lesion Classification via Multimodal Data and Auxiliary Task Integration

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Khurshid, Mahapara, Vatsa, Mayank, Singh, Richa
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911778267463680
author Khurshid, Mahapara
Vatsa, Mayank
Singh, Richa
author_facet Khurshid, Mahapara
Vatsa, Mayank
Singh, Richa
contents The rising global prevalence of skin conditions, some of which can escalate to life-threatening stages if not timely diagnosed and treated, presents a significant healthcare challenge. This issue is particularly acute in remote areas where limited access to healthcare often results in delayed treatment, allowing skin diseases to advance to more critical stages. One of the primary challenges in diagnosing skin diseases is their low inter-class variations, as many exhibit similar visual characteristics, making accurate classification challenging. This research introduces a novel multimodal method for classifying skin lesions, integrating smartphone-captured images with essential clinical and demographic information. This approach mimics the diagnostic process employed by medical professionals. A distinctive aspect of this method is the integration of an auxiliary task focused on super-resolution image prediction. This component plays a crucial role in refining visual details and enhancing feature extraction, leading to improved differentiation between classes and, consequently, elevating the overall effectiveness of the model. The experimental evaluations have been conducted using the PAD-UFES20 dataset, applying various deep-learning architectures. The results of these experiments not only demonstrate the effectiveness of the proposed method but also its potential applicability under-resourced healthcare environments.
format Preprint
id arxiv_https___arxiv_org_abs_2402_10454
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Optimizing Skin Lesion Classification via Multimodal Data and Auxiliary Task Integration
Khurshid, Mahapara
Vatsa, Mayank
Singh, Richa
Computer Vision and Pattern Recognition
The rising global prevalence of skin conditions, some of which can escalate to life-threatening stages if not timely diagnosed and treated, presents a significant healthcare challenge. This issue is particularly acute in remote areas where limited access to healthcare often results in delayed treatment, allowing skin diseases to advance to more critical stages. One of the primary challenges in diagnosing skin diseases is their low inter-class variations, as many exhibit similar visual characteristics, making accurate classification challenging. This research introduces a novel multimodal method for classifying skin lesions, integrating smartphone-captured images with essential clinical and demographic information. This approach mimics the diagnostic process employed by medical professionals. A distinctive aspect of this method is the integration of an auxiliary task focused on super-resolution image prediction. This component plays a crucial role in refining visual details and enhancing feature extraction, leading to improved differentiation between classes and, consequently, elevating the overall effectiveness of the model. The experimental evaluations have been conducted using the PAD-UFES20 dataset, applying various deep-learning architectures. The results of these experiments not only demonstrate the effectiveness of the proposed method but also its potential applicability under-resourced healthcare environments.
title Optimizing Skin Lesion Classification via Multimodal Data and Auxiliary Task Integration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.10454