Circular Belief Propagation for Approximate Probabilistic Inference

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Bouttier, Vincent, Jardri, Renaud, Deneve, Sophie
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916164177756160
author Bouttier, Vincent
Jardri, Renaud
Deneve, Sophie
author_facet Bouttier, Vincent
Jardri, Renaud
Deneve, Sophie
contents Belief Propagation (BP) is a simple probabilistic inference algorithm, consisting of passing messages between nodes of a graph representing a probability distribution. Its analogy with a neural network suggests that it could have far-ranging applications for neuroscience and artificial intelligence. Unfortunately, it is only exact when applied to cycle-free graphs, which restricts the potential of the algorithm. In this paper, we propose Circular Belief Propagation (CBP), an extension of BP which limits the detrimental effects of message reverberation caused by cycles by learning to detect and cancel spurious correlations and belief amplifications. We show in numerical experiments involving binary probabilistic graphs that CBP far outperforms BP and reaches good performance compared to that of previously proposed algorithms.
format Preprint
id arxiv_https___arxiv_org_abs_2403_12106
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Circular Belief Propagation for Approximate Probabilistic Inference
Bouttier, Vincent
Jardri, Renaud
Deneve, Sophie
Artificial Intelligence
Machine Learning
Belief Propagation (BP) is a simple probabilistic inference algorithm, consisting of passing messages between nodes of a graph representing a probability distribution. Its analogy with a neural network suggests that it could have far-ranging applications for neuroscience and artificial intelligence. Unfortunately, it is only exact when applied to cycle-free graphs, which restricts the potential of the algorithm. In this paper, we propose Circular Belief Propagation (CBP), an extension of BP which limits the detrimental effects of message reverberation caused by cycles by learning to detect and cancel spurious correlations and belief amplifications. We show in numerical experiments involving binary probabilistic graphs that CBP far outperforms BP and reaches good performance compared to that of previously proposed algorithms.
title Circular Belief Propagation for Approximate Probabilistic Inference
topic Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2403.12106