Bit Blasting Probabilistic Programs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Garg, Poorva, Holtzen, Steven, Broeck, Guy Van den, Millstein, Todd
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914845940514816
author Garg, Poorva
Holtzen, Steven
Broeck, Guy Van den
Millstein, Todd
author_facet Garg, Poorva
Holtzen, Steven
Broeck, Guy Van den
Millstein, Todd
contents Probabilistic programming languages (PPLs) are expressive means for creating and reasoning about probabilistic models. Unfortunately hybrid probabilistic programs, involving both continuous and discrete structures, are not well supported by today's PPLs. In this paper we develop a new approximate inference algorithm for hybrid probabilistic programs that first discretizes the continuous distributions and then performs discrete inference on the resulting program. The key novelty is a form of discretization that we call bit blasting, which uses a binary representation of numbers such that a domain of $2^b$ discretized points can be succinctly represented as a discrete probabilistic program over poly($b$) Boolean random variables. Surprisingly, we prove that many common continuous distributions can be bit blasted in a manner that incurs no loss of accuracy over an explicit discretization and supports efficient probabilistic inference. We have built a probabilistic programming system for hybrid programs called HyBit, which employs bit blasting followed by discrete probabilistic inference. We empirically demonstrate the benefits of our approach over existing sampling-based and symbolic inference approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2312_05706
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Bit Blasting Probabilistic Programs
Garg, Poorva
Holtzen, Steven
Broeck, Guy Van den
Millstein, Todd
Programming Languages
G.3
Probabilistic programming languages (PPLs) are expressive means for creating and reasoning about probabilistic models. Unfortunately hybrid probabilistic programs, involving both continuous and discrete structures, are not well supported by today's PPLs. In this paper we develop a new approximate inference algorithm for hybrid probabilistic programs that first discretizes the continuous distributions and then performs discrete inference on the resulting program. The key novelty is a form of discretization that we call bit blasting, which uses a binary representation of numbers such that a domain of $2^b$ discretized points can be succinctly represented as a discrete probabilistic program over poly($b$) Boolean random variables. Surprisingly, we prove that many common continuous distributions can be bit blasted in a manner that incurs no loss of accuracy over an explicit discretization and supports efficient probabilistic inference. We have built a probabilistic programming system for hybrid programs called HyBit, which employs bit blasting followed by discrete probabilistic inference. We empirically demonstrate the benefits of our approach over existing sampling-based and symbolic inference approaches.
title Bit Blasting Probabilistic Programs
topic Programming Languages
G.3
url https://arxiv.org/abs/2312.05706