Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2501.08821 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917893003804672 |
|---|---|
| author | Garov, Konstantin Chaudhuri, Kamalika |
| author_facet | Garov, Konstantin Chaudhuri, Kamalika |
| contents | Machine learning algorithms often encounter different or "out-of-distribution" (OOD) data at deployment time, and OOD detection is frequently employed to detect these examples. While it works reasonably well in practice, existing theoretical results on OOD detection are highly pessimistic. In this work, we take a closer look at this problem, and make a distinction between uniform and non-uniform learnability, following PAC learning theory. We characterize under what conditions OOD detection is uniformly and non-uniformly learnable, and we show that in several cases, non-uniform learnability turns a number of negative results into positive. In all cases where OOD detection is learnable, we provide concrete learning algorithms and a sample-complexity analysis. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_08821 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Closer Look at the Learnability of Out-of-Distribution (OOD) Detection Garov, Konstantin Chaudhuri, Kamalika Machine Learning Machine learning algorithms often encounter different or "out-of-distribution" (OOD) data at deployment time, and OOD detection is frequently employed to detect these examples. While it works reasonably well in practice, existing theoretical results on OOD detection are highly pessimistic. In this work, we take a closer look at this problem, and make a distinction between uniform and non-uniform learnability, following PAC learning theory. We characterize under what conditions OOD detection is uniformly and non-uniformly learnable, and we show that in several cases, non-uniform learnability turns a number of negative results into positive. In all cases where OOD detection is learnable, we provide concrete learning algorithms and a sample-complexity analysis. |
| title | A Closer Look at the Learnability of Out-of-Distribution (OOD) Detection |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2501.08821 |