Saved in:
Bibliographic Details
Main Authors: Mishal, Inbal, Weinshall, Daphna
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.01804
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908548474077184
author Mishal, Inbal
Weinshall, Daphna
author_facet Mishal, Inbal
Weinshall, Daphna
contents Deep Active Learning (AL) techniques can be effective in reducing annotation costs for training deep models. However, their effectiveness in low- and high-budget scenarios seems to require different strategies, and achieving optimal results across varying budget scenarios remains a challenge. In this study, we introduce Dynamic Coverage & Margin mix (DCoM), a novel active learning approach designed to bridge this gap. Unlike existing strategies, DCoM dynamically adjusts its strategy, considering the competence of the current model. Through theoretical analysis and empirical evaluations on diverse datasets, including challenging computer vision tasks, we demonstrate DCoM's ability to overcome the cold start problem and consistently improve results across different budgetary constraints. Thus DCoM achieves state-of-the-art performance in both low- and high-budget regimes.
format Preprint
id arxiv_https___arxiv_org_abs_2407_01804
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DCoM: Active Learning for All Learners
Mishal, Inbal
Weinshall, Daphna
Machine Learning
Deep Active Learning (AL) techniques can be effective in reducing annotation costs for training deep models. However, their effectiveness in low- and high-budget scenarios seems to require different strategies, and achieving optimal results across varying budget scenarios remains a challenge. In this study, we introduce Dynamic Coverage & Margin mix (DCoM), a novel active learning approach designed to bridge this gap. Unlike existing strategies, DCoM dynamically adjusts its strategy, considering the competence of the current model. Through theoretical analysis and empirical evaluations on diverse datasets, including challenging computer vision tasks, we demonstrate DCoM's ability to overcome the cold start problem and consistently improve results across different budgetary constraints. Thus DCoM achieves state-of-the-art performance in both low- and high-budget regimes.
title DCoM: Active Learning for All Learners
topic Machine Learning
url https://arxiv.org/abs/2407.01804