ExDBN: Learning Dynamic Bayesian Networks using Extended Mixed-Integer Programming Formulations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Rytir, Pavel, Wodecki, Ales, Korpas, Georgios, Marecek, Jakub
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915704694898688
author Rytir, Pavel
Wodecki, Ales
Korpas, Georgios
Marecek, Jakub
author_facet Rytir, Pavel
Wodecki, Ales
Korpas, Georgios
Marecek, Jakub
contents Causal learning from data has received much attention recently. Bayesian networks can be used to capture causal relationships. There, one recovers a weighted directed acyclic graph in which random variables are represented by vertices, and the weights associated with each edge represent the strengths of the causal relationships between them. This concept is extended to capture dynamic effects by introducing a dependency on past data, which may be captured by the structural equation model. This formalism is utilized in the present contribution to propose a score-based learning algorithm. A mixed-integer quadratic program is formulated and an algorithmic solution proposed, in which the pre-generation of exponentially many acyclicity constraints is avoided by utilizing the so-called branch-and-cut (``lazy constraint'') method. Comparing the novel approach to the state-of-the-art, we show that the proposed approach turns out to produce more accurate results when applied to small and medium-sized synthetic instances containing up to 80 time series. Lastly, two interesting applications in bioscience and finance, to which the method is directly applied, further stress the importance of developing highly accurate, globally convergent solvers that can handle instances of modest size.
format Preprint
id arxiv_https___arxiv_org_abs_2410_16100
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ExDBN: Learning Dynamic Bayesian Networks using Extended Mixed-Integer Programming Formulations
Rytir, Pavel
Wodecki, Ales
Korpas, Georgios
Marecek, Jakub
Machine Learning
Causal learning from data has received much attention recently. Bayesian networks can be used to capture causal relationships. There, one recovers a weighted directed acyclic graph in which random variables are represented by vertices, and the weights associated with each edge represent the strengths of the causal relationships between them. This concept is extended to capture dynamic effects by introducing a dependency on past data, which may be captured by the structural equation model. This formalism is utilized in the present contribution to propose a score-based learning algorithm. A mixed-integer quadratic program is formulated and an algorithmic solution proposed, in which the pre-generation of exponentially many acyclicity constraints is avoided by utilizing the so-called branch-and-cut (``lazy constraint'') method. Comparing the novel approach to the state-of-the-art, we show that the proposed approach turns out to produce more accurate results when applied to small and medium-sized synthetic instances containing up to 80 time series. Lastly, two interesting applications in bioscience and finance, to which the method is directly applied, further stress the importance of developing highly accurate, globally convergent solvers that can handle instances of modest size.
title ExDBN: Learning Dynamic Bayesian Networks using Extended Mixed-Integer Programming Formulations
topic Machine Learning
url https://arxiv.org/abs/2410.16100