Generative Posterior Networks for Approximately Bayesian Epistemic Uncertainty Estimation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910283437441024 |
|---|---|
| author | Roderick, Melrose Berkenkamp, Felix Sheikholeslami, Fatemeh Kolter, Zico |
| author_facet | Roderick, Melrose Berkenkamp, Felix Sheikholeslami, Fatemeh Kolter, Zico |
| contents | In many real-world problems, there is a limited set of training data, but an abundance of unlabeled data. We propose a new method, Generative Posterior Networks (GPNs), that uses unlabeled data to estimate epistemic uncertainty in high-dimensional problems. A GPN is a generative model that, given a prior distribution over functions, approximates the posterior distribution directly by regularizing the network towards samples from the prior. We prove theoretically that our method indeed approximates the Bayesian posterior and show empirically that it improves epistemic uncertainty estimation and scalability over competing methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_17411 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Generative Posterior Networks for Approximately Bayesian Epistemic Uncertainty Estimation Roderick, Melrose Berkenkamp, Felix Sheikholeslami, Fatemeh Kolter, Zico Machine Learning In many real-world problems, there is a limited set of training data, but an abundance of unlabeled data. We propose a new method, Generative Posterior Networks (GPNs), that uses unlabeled data to estimate epistemic uncertainty in high-dimensional problems. A GPN is a generative model that, given a prior distribution over functions, approximates the posterior distribution directly by regularizing the network towards samples from the prior. We prove theoretically that our method indeed approximates the Bayesian posterior and show empirically that it improves epistemic uncertainty estimation and scalability over competing methods. |
| title | Generative Posterior Networks for Approximately Bayesian Epistemic Uncertainty Estimation |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2312.17411 |