Rethinking Foundation Models for Medical Image Classification through a Benchmark Study on MedMNIST

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Fuping, Papiez, Bartlomiej W.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909465515655168
author Wu, Fuping
Papiez, Bartlomiej W.
author_facet Wu, Fuping
Papiez, Bartlomiej W.
contents Foundation models are widely employed in medical image analysis, due to their high adaptability and generalizability for downstream tasks. With the increasing number of foundation models being released, model selection has become an important issue. In this work, we study the capabilities of foundation models in medical image classification tasks by conducting a benchmark study on the MedMNIST dataset. Specifically, we adopt various foundation models ranging from convolutional to Transformer-based models and implement both end-to-end training and linear probing for all classification tasks. The results demonstrate the significant potential of these pre-trained models when transferred for medical image classification. We further conduct experiments with different image sizes and various sizes of training data. By analyzing all the results, we provide preliminary, yet useful insights and conclusions on this topic.
format Preprint
id arxiv_https___arxiv_org_abs_2501_14685
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Rethinking Foundation Models for Medical Image Classification through a Benchmark Study on MedMNIST
Wu, Fuping
Papiez, Bartlomiej W.
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
Foundation models are widely employed in medical image analysis, due to their high adaptability and generalizability for downstream tasks. With the increasing number of foundation models being released, model selection has become an important issue. In this work, we study the capabilities of foundation models in medical image classification tasks by conducting a benchmark study on the MedMNIST dataset. Specifically, we adopt various foundation models ranging from convolutional to Transformer-based models and implement both end-to-end training and linear probing for all classification tasks. The results demonstrate the significant potential of these pre-trained models when transferred for medical image classification. We further conduct experiments with different image sizes and various sizes of training data. By analyzing all the results, we provide preliminary, yet useful insights and conclusions on this topic.
title Rethinking Foundation Models for Medical Image Classification through a Benchmark Study on MedMNIST
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2501.14685