RADS: Reinforcement Learning-Based Sample Selection Improves Transfer Learning in Low-resource and Imbalanced Clinical Settings

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Han, Wei, Martinez, David, Khanina, Anna, Cavedon, Lawrence, Verspoor, Karin
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917427818790912
author Han, Wei
Martinez, David
Khanina, Anna
Cavedon, Lawrence
Verspoor, Karin
author_facet Han, Wei
Martinez, David
Khanina, Anna
Cavedon, Lawrence
Verspoor, Karin
contents A common strategy in transfer learning is few shot fine-tuning, but its success is highly dependent on the quality of samples selected as training examples. Active learning methods such as uncertainty sampling and diversity sampling can select useful samples. However, under extremely low-resource and class-imbalanced conditions, they often favor outliers rather than truly informative samples, resulting in degraded performance. In this paper, we introduce RADS (Reinforcement Adaptive Domain Sampling), a robust sample selection strategy using reinforcement learning (RL) to identify the most informative samples. Experimental evaluations on several real world clinical datasets show our sample selection strategy enhances model transferability while maintaining robust performance under extreme class imbalance compared to traditional methods.
format Preprint
id arxiv_https___arxiv_org_abs_2604_20256
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle RADS: Reinforcement Learning-Based Sample Selection Improves Transfer Learning in Low-resource and Imbalanced Clinical Settings
Han, Wei
Martinez, David
Khanina, Anna
Cavedon, Lawrence
Verspoor, Karin
Computation and Language
Machine Learning
A common strategy in transfer learning is few shot fine-tuning, but its success is highly dependent on the quality of samples selected as training examples. Active learning methods such as uncertainty sampling and diversity sampling can select useful samples. However, under extremely low-resource and class-imbalanced conditions, they often favor outliers rather than truly informative samples, resulting in degraded performance. In this paper, we introduce RADS (Reinforcement Adaptive Domain Sampling), a robust sample selection strategy using reinforcement learning (RL) to identify the most informative samples. Experimental evaluations on several real world clinical datasets show our sample selection strategy enhances model transferability while maintaining robust performance under extreme class imbalance compared to traditional methods.
title RADS: Reinforcement Learning-Based Sample Selection Improves Transfer Learning in Low-resource and Imbalanced Clinical Settings
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2604.20256