Saved in:
Bibliographic Details
Main Author: Dossou, Bonaventure F. P.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.15721
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914695615610880
author Dossou, Bonaventure F. P.
author_facet Dossou, Bonaventure F. P.
contents The Deep Learning revolution has enabled groundbreaking achievements in recent years. From breast cancer detection to protein folding, deep learning algorithms have been at the core of very important advancements. However, these modern advancements are becoming more and more data-hungry, especially on labeled data whose availability is scarce: this is even more prevalent in the medical context. In this work, we show how active learning could be very effective in data scarcity situations, where obtaining labeled data (or annotation budget is very limited). We compare several selection criteria (BALD, MeanSTD, and MaxEntropy) on the ISIC 2016 dataset. We also explored the effect of acquired pool size on the model's performance. Our results suggest that uncertainty is useful to the Melanoma detection task, and confirms the hypotheses of the author of the paper of interest, that \textit{bald} performs on average better than other acquisition functions. Our extended analyses however revealed that all acquisition functions perform badly on the positive (cancerous) samples, suggesting exploitation of class unbalance, which could be crucial in real-world settings. We finish by suggesting future work directions that would be useful to improve this current work. The code of our implementation is open-sourced at \url{https://github.com/bonaventuredossou/ece526_course_project}
format Preprint
id arxiv_https___arxiv_org_abs_2401_15721
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Study of Acquisition Functions for Medical Imaging Deep Active Learning
Dossou, Bonaventure F. P.
Computer Vision and Pattern Recognition
Artificial Intelligence
Human-Computer Interaction
Machine Learning
The Deep Learning revolution has enabled groundbreaking achievements in recent years. From breast cancer detection to protein folding, deep learning algorithms have been at the core of very important advancements. However, these modern advancements are becoming more and more data-hungry, especially on labeled data whose availability is scarce: this is even more prevalent in the medical context. In this work, we show how active learning could be very effective in data scarcity situations, where obtaining labeled data (or annotation budget is very limited). We compare several selection criteria (BALD, MeanSTD, and MaxEntropy) on the ISIC 2016 dataset. We also explored the effect of acquired pool size on the model's performance. Our results suggest that uncertainty is useful to the Melanoma detection task, and confirms the hypotheses of the author of the paper of interest, that \textit{bald} performs on average better than other acquisition functions. Our extended analyses however revealed that all acquisition functions perform badly on the positive (cancerous) samples, suggesting exploitation of class unbalance, which could be crucial in real-world settings. We finish by suggesting future work directions that would be useful to improve this current work. The code of our implementation is open-sourced at \url{https://github.com/bonaventuredossou/ece526_course_project}
title A Study of Acquisition Functions for Medical Imaging Deep Active Learning
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2401.15721