Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Roderick, Melrose, Berkenkamp, Felix, Sheikholeslami, Fatemeh, Kolter, Zico
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2312.17411
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910283437441024
author Roderick, Melrose
Berkenkamp, Felix
Sheikholeslami, Fatemeh
Kolter, Zico
author_facet Roderick, Melrose
Berkenkamp, Felix
Sheikholeslami, Fatemeh
Kolter, Zico
contents In many real-world problems, there is a limited set of training data, but an abundance of unlabeled data. We propose a new method, Generative Posterior Networks (GPNs), that uses unlabeled data to estimate epistemic uncertainty in high-dimensional problems. A GPN is a generative model that, given a prior distribution over functions, approximates the posterior distribution directly by regularizing the network towards samples from the prior. We prove theoretically that our method indeed approximates the Bayesian posterior and show empirically that it improves epistemic uncertainty estimation and scalability over competing methods.
format Preprint
id arxiv_https___arxiv_org_abs_2312_17411
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Generative Posterior Networks for Approximately Bayesian Epistemic Uncertainty Estimation
Roderick, Melrose
Berkenkamp, Felix
Sheikholeslami, Fatemeh
Kolter, Zico
Machine Learning
In many real-world problems, there is a limited set of training data, but an abundance of unlabeled data. We propose a new method, Generative Posterior Networks (GPNs), that uses unlabeled data to estimate epistemic uncertainty in high-dimensional problems. A GPN is a generative model that, given a prior distribution over functions, approximates the posterior distribution directly by regularizing the network towards samples from the prior. We prove theoretically that our method indeed approximates the Bayesian posterior and show empirically that it improves epistemic uncertainty estimation and scalability over competing methods.
title Generative Posterior Networks for Approximately Bayesian Epistemic Uncertainty Estimation
topic Machine Learning
url https://arxiv.org/abs/2312.17411