Uncertainty Quantification in Continual Open-World Learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915074969436160 |
|---|---|
| author | Rios, Amanda S. Ndiour, Ibrahima J. Datta, Parual Sydir, Jaroslaw Tickoo, Omesh Ahuja, Nilesh |
| author_facet | Rios, Amanda S. Ndiour, Ibrahima J. Datta, Parual Sydir, Jaroslaw Tickoo, Omesh Ahuja, Nilesh |
| contents | AI deployed in the real-world should be capable of autonomously adapting to novelties encountered after deployment. Yet, in the field of continual learning, the reliance on novelty and labeling oracles is commonplace albeit unrealistic. This paper addresses a challenging and under-explored problem: a deployed AI agent that continuously encounters unlabeled data - which may include both unseen samples of known classes and samples from novel (unknown) classes - and must adapt to it continuously. To tackle this challenge, we propose our method COUQ "Continual Open-world Uncertainty Quantification", an iterative uncertainty estimation algorithm tailored for learning in generalized continual open-world multi-class settings. We rigorously apply and evaluate COUQ on key sub-tasks in the Continual Open-World: continual novelty detection, uncertainty guided active learning, and uncertainty guided pseudo-labeling for semi-supervised CL. We demonstrate the effectiveness of our method across multiple datasets, ablations, backbones and performance superior to state-of-the-art. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_16409 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Uncertainty Quantification in Continual Open-World Learning Rios, Amanda S. Ndiour, Ibrahima J. Datta, Parual Sydir, Jaroslaw Tickoo, Omesh Ahuja, Nilesh Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition I.2; I.4 AI deployed in the real-world should be capable of autonomously adapting to novelties encountered after deployment. Yet, in the field of continual learning, the reliance on novelty and labeling oracles is commonplace albeit unrealistic. This paper addresses a challenging and under-explored problem: a deployed AI agent that continuously encounters unlabeled data - which may include both unseen samples of known classes and samples from novel (unknown) classes - and must adapt to it continuously. To tackle this challenge, we propose our method COUQ "Continual Open-world Uncertainty Quantification", an iterative uncertainty estimation algorithm tailored for learning in generalized continual open-world multi-class settings. We rigorously apply and evaluate COUQ on key sub-tasks in the Continual Open-World: continual novelty detection, uncertainty guided active learning, and uncertainty guided pseudo-labeling for semi-supervised CL. We demonstrate the effectiveness of our method across multiple datasets, ablations, backbones and performance superior to state-of-the-art. |
| title | Uncertainty Quantification in Continual Open-World Learning |
| topic | Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition I.2; I.4 |
| url | https://arxiv.org/abs/2412.16409 |