CUAL: Continual Uncertainty-aware Active Learner
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909425719050240 |
|---|---|
| author | Rios, Amanda Ndiour, Ibrahima Datta, Parual Sydir, Jerry Tickoo, Omesh Ahuja, Nilesh |
| author_facet | Rios, Amanda Ndiour, Ibrahima Datta, Parual Sydir, Jerry Tickoo, Omesh Ahuja, Nilesh |
| contents | AI deployed in many real-world use cases should be capable of adapting to novelties encountered after deployment. Here, we consider a challenging, under-explored and realistic continual adaptation problem: a deployed AI agent is continuously provided with unlabeled data that may contain not only unseen samples of known classes but also samples from novel (unknown) classes. In such a challenging setting, it has only a tiny labeling budget to query the most informative samples to help it continuously learn. We present a comprehensive solution to this complex problem with our model "CUAL" (Continual Uncertainty-aware Active Learner). CUAL leverages an uncertainty estimation algorithm to prioritize active labeling of ambiguous (uncertain) predicted novel class samples while also simultaneously pseudo-labeling the most certain predictions of each class. Evaluations across multiple datasets, ablations, settings and backbones (e.g. ViT foundation model) demonstrate our method's effectiveness. We will release our code upon acceptance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_09701 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CUAL: Continual Uncertainty-aware Active Learner Rios, Amanda Ndiour, Ibrahima Datta, Parual Sydir, Jerry Tickoo, Omesh Ahuja, Nilesh Machine Learning Artificial Intelligence AI deployed in many real-world use cases should be capable of adapting to novelties encountered after deployment. Here, we consider a challenging, under-explored and realistic continual adaptation problem: a deployed AI agent is continuously provided with unlabeled data that may contain not only unseen samples of known classes but also samples from novel (unknown) classes. In such a challenging setting, it has only a tiny labeling budget to query the most informative samples to help it continuously learn. We present a comprehensive solution to this complex problem with our model "CUAL" (Continual Uncertainty-aware Active Learner). CUAL leverages an uncertainty estimation algorithm to prioritize active labeling of ambiguous (uncertain) predicted novel class samples while also simultaneously pseudo-labeling the most certain predictions of each class. Evaluations across multiple datasets, ablations, settings and backbones (e.g. ViT foundation model) demonstrate our method's effectiveness. We will release our code upon acceptance. |
| title | CUAL: Continual Uncertainty-aware Active Learner |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2412.09701 |