Saved in:
Bibliographic Details
Main Authors: Ji, Anyang, Kang, Qingbo, Xu, Wei, Wang, Changfan, Li, Kang, Lao, Qicheng
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2503.00744
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929738480615424
author Ji, Anyang
Kang, Qingbo
Xu, Wei
Wang, Changfan
Li, Kang
Lao, Qicheng
author_facet Ji, Anyang
Kang, Qingbo
Xu, Wei
Wang, Changfan
Li, Kang
Lao, Qicheng
contents The emergence of large-scale pre-trained vision foundation models has greatly advanced the medical imaging field through the pre-training and fine-tuning paradigm. However, selecting appropriate medical data for downstream fine-tuning remains a significant challenge considering its annotation cost, privacy concerns, and the detrimental effects of confounding variables. In this work, we present a confounder-aware medical data selection approach for medical dataset curation aiming to select minimal representative data by strategically mitigating the undesirable impact of confounding variables while preserving the natural distribution of the dataset. Our approach first identifies confounding variables within data and then develops a distance-based data selection strategy for confounder-aware sampling with a constrained budget in the data size. We validate the superiority of our approach through extensive experiments across diverse medical imaging modalities, highlighting its effectiveness in addressing the substantial impact of confounding variables and enhancing the fine-tuning efficiency in the medical imaging domain, compared to other data selection approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2503_00744
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Confounder-Aware Medical Data Selection for Fine-Tuning Pretrained Vision Models
Ji, Anyang
Kang, Qingbo
Xu, Wei
Wang, Changfan
Li, Kang
Lao, Qicheng
Computer Vision and Pattern Recognition
Artificial Intelligence
The emergence of large-scale pre-trained vision foundation models has greatly advanced the medical imaging field through the pre-training and fine-tuning paradigm. However, selecting appropriate medical data for downstream fine-tuning remains a significant challenge considering its annotation cost, privacy concerns, and the detrimental effects of confounding variables. In this work, we present a confounder-aware medical data selection approach for medical dataset curation aiming to select minimal representative data by strategically mitigating the undesirable impact of confounding variables while preserving the natural distribution of the dataset. Our approach first identifies confounding variables within data and then develops a distance-based data selection strategy for confounder-aware sampling with a constrained budget in the data size. We validate the superiority of our approach through extensive experiments across diverse medical imaging modalities, highlighting its effectiveness in addressing the substantial impact of confounding variables and enhancing the fine-tuning efficiency in the medical imaging domain, compared to other data selection approaches.
title Confounder-Aware Medical Data Selection for Fine-Tuning Pretrained Vision Models
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2503.00744