Learning Dynamic Bayesian Networks from Data: Foundations, First Principles and Numerical Comparisons

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Kungurtsev, Vyacheslav, Idlahcen, Fadwa, Rysavy, Petr, Rytir, Pavel, Wodecki, Ales
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916375230939136
author Kungurtsev, Vyacheslav
Idlahcen, Fadwa
Rysavy, Petr
Rytir, Pavel
Wodecki, Ales
author_facet Kungurtsev, Vyacheslav
Idlahcen, Fadwa
Rysavy, Petr
Rytir, Pavel
Wodecki, Ales
contents In this paper, we present a guide to the foundations of learning Dynamic Bayesian Networks (DBNs) from data in the form of multiple samples of trajectories for some length of time. We present the formalism for a generic as well as a set of common types of DBNs for particular variable distributions. We present the analytical form of the models, with a comprehensive discussion on the interdependence between structure and weights in a DBN model and their implications for learning. Next, we give a broad overview of learning methods and describe and categorize them based on the most important statistical features, and how they treat the interplay between learning structure and weights. We give the analytical form of the likelihood and Bayesian score functions, emphasizing the distinction from the static case. We discuss functions used in optimization to enforce structural requirements. We briefly discuss more complex extensions and representations. Finally we present a set of comparisons in different settings for various distinct but representative algorithms across the variants.
format Preprint
id arxiv_https___arxiv_org_abs_2406_17585
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Dynamic Bayesian Networks from Data: Foundations, First Principles and Numerical Comparisons
Kungurtsev, Vyacheslav
Idlahcen, Fadwa
Rysavy, Petr
Rytir, Pavel
Wodecki, Ales
Machine Learning
Statistics Theory
In this paper, we present a guide to the foundations of learning Dynamic Bayesian Networks (DBNs) from data in the form of multiple samples of trajectories for some length of time. We present the formalism for a generic as well as a set of common types of DBNs for particular variable distributions. We present the analytical form of the models, with a comprehensive discussion on the interdependence between structure and weights in a DBN model and their implications for learning. Next, we give a broad overview of learning methods and describe and categorize them based on the most important statistical features, and how they treat the interplay between learning structure and weights. We give the analytical form of the likelihood and Bayesian score functions, emphasizing the distinction from the static case. We discuss functions used in optimization to enforce structural requirements. We briefly discuss more complex extensions and representations. Finally we present a set of comparisons in different settings for various distinct but representative algorithms across the variants.
title Learning Dynamic Bayesian Networks from Data: Foundations, First Principles and Numerical Comparisons
topic Machine Learning
Statistics Theory
url https://arxiv.org/abs/2406.17585