Saved in:
Bibliographic Details
Main Authors: Lee, Changwoo J., Zito, Alessandro, Sang, Huiyan, Dunson, David B.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2402.07048
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912275483328512
author Lee, Changwoo J.
Zito, Alessandro
Sang, Huiyan
Dunson, David B.
author_facet Lee, Changwoo J.
Zito, Alessandro
Sang, Huiyan
Dunson, David B.
contents The beta distribution serves as a canonical tool for modeling probabilities in statistics and machine learning. However, there is limited work on flexible and computationally convenient stochastic process extensions for modeling dependent random probabilities. We propose a novel stochastic process called the logistic-beta process, whose logistic transformation yields a stochastic process with common beta marginals. Logistic-beta processes can model dependence on both discrete and continuous domains, such as space or time, and have a flexible dependence structure through correlation kernels. Moreover, its normal variance-mean mixture representation leads to effective posterior inference algorithms. We show how the proposed logistic-beta process can be used to design computationally tractable dependent Bayesian nonparametric models, including dependent Dirichlet processes and extensions. We illustrate the benefits through nonparametric binary regression and conditional density estimation examples, both in simulation studies and in a pregnancy outcome application.
format Preprint
id arxiv_https___arxiv_org_abs_2402_07048
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Logistic-beta processes for dependent random probabilities with beta marginals
Lee, Changwoo J.
Zito, Alessandro
Sang, Huiyan
Dunson, David B.
Methodology
Machine Learning
The beta distribution serves as a canonical tool for modeling probabilities in statistics and machine learning. However, there is limited work on flexible and computationally convenient stochastic process extensions for modeling dependent random probabilities. We propose a novel stochastic process called the logistic-beta process, whose logistic transformation yields a stochastic process with common beta marginals. Logistic-beta processes can model dependence on both discrete and continuous domains, such as space or time, and have a flexible dependence structure through correlation kernels. Moreover, its normal variance-mean mixture representation leads to effective posterior inference algorithms. We show how the proposed logistic-beta process can be used to design computationally tractable dependent Bayesian nonparametric models, including dependent Dirichlet processes and extensions. We illustrate the benefits through nonparametric binary regression and conditional density estimation examples, both in simulation studies and in a pregnancy outcome application.
title Logistic-beta processes for dependent random probabilities with beta marginals
topic Methodology
Machine Learning
url https://arxiv.org/abs/2402.07048