Saved in:
Bibliographic Details
Main Authors: Dey, Durjoy, Yan, Yuhong, Hajjdiab, Hassan
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2605.26294
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918523144503296
author Dey, Durjoy
Yan, Yuhong
Hajjdiab, Hassan
author_facet Dey, Durjoy
Yan, Yuhong
Hajjdiab, Hassan
contents Skin cancer is a common and fast rising malignancy worldwide. Early detection is critical for improving outcomes. Deep learning models trained on dermoscopic and clinical images can support automated and fast triage. However, many studies evaluate only a limited set of architectures. Experimental setups also vary across studies. In this paper, we present a unified evaluation of twelve deep learning models for binary skin cancer detection on the PAD-UFES-20 dataset. The models span four families: convolutional neural networks (CNN), vision transformers (ViT), hybrid convolution transformer backbones, and vision language models (VLM). Performance is assessed using AUC, the maximum F1 score with its precision and recall, and sensitivity at 80% specificity, reflecting screening oriented requirements. Our results show that well tuned CNNs already provide strong baselines, but transformer based families consistently improve discrimination. Hybrid models (MaxViT Tiny, CoAtNet0) and a SigLIP based VLM achieve the best overall trade off between ranking performance and clinically relevant operating points, while CLIP based model offers high precision. The full codebase for all experiments is publicly released. Together, these findings offer practical guidance on which model families are most suitable for real world deployment in skin cancer screening and establish a reproducible reference point for future work on PAD-UFES-20.
format Preprint
id arxiv_https___arxiv_org_abs_2605_26294
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CNNs, Transformers, Hybrid, and Vision Language Models for Skin Cancer Detection
Dey, Durjoy
Yan, Yuhong
Hajjdiab, Hassan
Computer Vision and Pattern Recognition
Skin cancer is a common and fast rising malignancy worldwide. Early detection is critical for improving outcomes. Deep learning models trained on dermoscopic and clinical images can support automated and fast triage. However, many studies evaluate only a limited set of architectures. Experimental setups also vary across studies. In this paper, we present a unified evaluation of twelve deep learning models for binary skin cancer detection on the PAD-UFES-20 dataset. The models span four families: convolutional neural networks (CNN), vision transformers (ViT), hybrid convolution transformer backbones, and vision language models (VLM). Performance is assessed using AUC, the maximum F1 score with its precision and recall, and sensitivity at 80% specificity, reflecting screening oriented requirements. Our results show that well tuned CNNs already provide strong baselines, but transformer based families consistently improve discrimination. Hybrid models (MaxViT Tiny, CoAtNet0) and a SigLIP based VLM achieve the best overall trade off between ranking performance and clinically relevant operating points, while CLIP based model offers high precision. The full codebase for all experiments is publicly released. Together, these findings offer practical guidance on which model families are most suitable for real world deployment in skin cancer screening and establish a reproducible reference point for future work on PAD-UFES-20.
title CNNs, Transformers, Hybrid, and Vision Language Models for Skin Cancer Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2605.26294