Probabilistic Circuits with Constraints via Convex Optimization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ghandi, Soroush, Quost, Benjamin, de Campos, Cassio
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914721043578880
author Ghandi, Soroush
Quost, Benjamin
de Campos, Cassio
author_facet Ghandi, Soroush
Quost, Benjamin
de Campos, Cassio
contents This work addresses integrating probabilistic propositional logic constraints into the distribution encoded by a probabilistic circuit (PC). PCs are a class of tractable models that allow efficient computations (such as conditional and marginal probabilities) while achieving state-of-the-art performance in some domains. The proposed approach takes both a PC and constraints as inputs, and outputs a new PC that satisfies the constraints. This is done efficiently via convex optimization without the need to retrain the entire model. Empirical evaluations indicate that the combination of constraints and PCs can have multiple use cases, including the improvement of model performance under scarce or incomplete data, as well as the enforcement of machine learning fairness measures into the model without compromising model fitness. We believe that these ideas will open possibilities for multiple other applications involving the combination of logics and deep probabilistic models.
format Preprint
id arxiv_https___arxiv_org_abs_2403_13125
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Probabilistic Circuits with Constraints via Convex Optimization
Ghandi, Soroush
Quost, Benjamin
de Campos, Cassio
Machine Learning
Artificial Intelligence
This work addresses integrating probabilistic propositional logic constraints into the distribution encoded by a probabilistic circuit (PC). PCs are a class of tractable models that allow efficient computations (such as conditional and marginal probabilities) while achieving state-of-the-art performance in some domains. The proposed approach takes both a PC and constraints as inputs, and outputs a new PC that satisfies the constraints. This is done efficiently via convex optimization without the need to retrain the entire model. Empirical evaluations indicate that the combination of constraints and PCs can have multiple use cases, including the improvement of model performance under scarce or incomplete data, as well as the enforcement of machine learning fairness measures into the model without compromising model fitness. We believe that these ideas will open possibilities for multiple other applications involving the combination of logics and deep probabilistic models.
title Probabilistic Circuits with Constraints via Convex Optimization
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2403.13125