Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2505.16923 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916754162188288 |
|---|---|
| author | Zhang, Yuhui Wu, Dongshen Wada, Yuichiro Kanamori, Takafumi |
| author_facet | Zhang, Yuhui Wu, Dongshen Wada, Yuichiro Kanamori, Takafumi |
| contents | A reliable uncertainty estimation method is the foundation of many modern out-of-distribution (OOD) detectors, which are critical for safe deployments of deep learning models in the open world. In this work, we propose TULiP, a theoretically-driven post-hoc uncertainty estimator for OOD detection. Our approach considers a hypothetical perturbation applied to the network before convergence. Based on linearized training dynamics, we bound the effect of such perturbation, resulting in an uncertainty score computable by perturbing model parameters. Ultimately, our approach computes uncertainty from a set of sampled predictions. We visualize our bound on synthetic regression and classification datasets. Furthermore, we demonstrate the effectiveness of TULiP using large-scale OOD detection benchmarks for image classification. Our method exhibits state-of-the-art performance, particularly for near-distribution samples. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_16923 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | TULiP: Test-time Uncertainty Estimation via Linearization and Weight Perturbation Zhang, Yuhui Wu, Dongshen Wada, Yuichiro Kanamori, Takafumi Machine Learning A reliable uncertainty estimation method is the foundation of many modern out-of-distribution (OOD) detectors, which are critical for safe deployments of deep learning models in the open world. In this work, we propose TULiP, a theoretically-driven post-hoc uncertainty estimator for OOD detection. Our approach considers a hypothetical perturbation applied to the network before convergence. Based on linearized training dynamics, we bound the effect of such perturbation, resulting in an uncertainty score computable by perturbing model parameters. Ultimately, our approach computes uncertainty from a set of sampled predictions. We visualize our bound on synthetic regression and classification datasets. Furthermore, we demonstrate the effectiveness of TULiP using large-scale OOD detection benchmarks for image classification. Our method exhibits state-of-the-art performance, particularly for near-distribution samples. |
| title | TULiP: Test-time Uncertainty Estimation via Linearization and Weight Perturbation |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2505.16923 |