Cover Image

Entropy and the Kullback-Leibler Divergence for Bayesian Networks: Computational Complexity and Efficient Implementation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Scutari, Marco
Format:	Preprint
Published:	2023
Subjects:	Artificial Intelligence Machine Learning Computation
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Generalized Kullback-Leibler Divergence Loss
by: Cui, Jiequan, et al.
Published: (2025)

Better Estimation of the Kullback--Leibler Divergence Between Language Models
by: Amini, Afra, et al.
Published: (2025)

Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
by: Lv, Jiaming, et al.
Published: (2024)

Diversity-Aware Reverse Kullback-Leibler Divergence for Large Language Model Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)

Decoupled Kullback-Leibler Divergence Loss
by: Cui, Jiequan, et al.
Published: (2023)

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
by: Wu, Taiqiang, et al.
Published: (2024)

Probabilistic classification from possibilistic data: computing Kullback-Leibler projection with a possibility distribution
by: Baaj, Ismaïl, et al.
Published: (2026)

Benchmarking Constraint-Based Bayesian Structure Learning Algorithms: Role of Network Topology
by: Nagarajan, Radha, et al.
Published: (2025)

Nearly Minimax Discrete Distribution Estimation in Kullback-Leibler Divergence with High Probability
by: van der Hoeven, Dirk, et al.
Published: (2025)

Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distance
by: Yang, Huchen, et al.
Published: (2026)

Relaxed Triangle Inequality for Kullback-Leibler Divergence Between Multivariate Gaussian Distributions
by: Xiao, Shiji, et al.
Published: (2026)

Vocabulary Expansion of Large Language Models via Kullback-Leibler-Based Self-Distillation
by: Linder, Max Rehman
Published: (2025)

CAKD: A Correlation-Aware Knowledge Distillation Framework Based on Decoupling Kullback-Leibler Divergence
by: Zhang, Zao, et al.
Published: (2024)

Connecting Jensen-Shannon and Kullback-Leibler Divergences: A New Bound for Representation Learning
by: Dorent, Reuben, et al.
Published: (2025)

The Jacobian and Hessian of the Kullback-Leibler Divergence between Multivariate Gaussian Distributions (Technical Report)
by: Maroñas, Juan
Published: (2025)

Bayesian Pseudo-Coresets via Contrastive Divergence
by: Tiwary, Piyush, et al.
Published: (2023)

On the Computational Capability of Graph Neural Networks: A Circuit Complexity Bound Perspective
by: Li, Xiaoyu, et al.
Published: (2025)

Risk Bounds for Mixture Density Estimation on Compact Domains via the $h$-Lifted Kullback--Leibler Divergence
by: Chong, Mark Chiu, et al.
Published: (2024)

Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distribution
by: Zenn, Johannes, et al.
Published: (2024)

Entropy Meets Importance: A Unified Head Importance-Entropy Score for Stable and Efficient Transformer Pruning
by: Choi, Minsik, et al.
Published: (2025)

Native Fortran Implementation of TensorFlow-Trained Deep and Bayesian Neural Networks
by: Furlong, Aidan, et al.
Published: (2025)

Kullback-Leibler Barycentre of Stochastic Processes
by: Jaimungal, Sebastian, et al.
Published: (2024)

Entropy Adaptive Decoding: Dynamic Model Switching for Efficient Inference
by: Simonds, Toby
Published: (2025)

A Note on Bayesian Networks with Latent Root Variables
by: Zaffalon, Marco, et al.
Published: (2024)

Scaling Stick-Breaking Attention: An Efficient Implementation and In-depth Study
by: Tan, Shawn, et al.
Published: (2024)

A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows
by: Crucinio, Francesca Romana
Published: (2025)

Understanding and Improving Shampoo and SOAP via Kullback-Leibler Minimization
by: Lin, Wu, et al.
Published: (2025)

GTPO: Stabilizing Group Relative Policy Optimization via Gradient and Entropy Control
by: Simoni, Marco, et al.
Published: (2025)

Restricted Bayesian Neural Network
by: Ganguly, Sourav, et al.
Published: (2024)

A Kullback-Leibler divergence method for input-system-state identification
by: Impraimakis, Marios
Published: (2025)

Efficient Agent Training for Computer Use
by: He, Yanheng, et al.
Published: (2025)

LLM Safety Alignment is Divergence Estimation in Disguise
by: Haldar, Rajdeep, et al.
Published: (2025)

From Overfitting to Reliability: Introducing the Hierarchical Approximate Bayesian Neural Network
by: Amirkhanian, Hayk, et al.
Published: (2025)

Symbolic Foundation Regressor on Complex Networks
by: Liu, Weiting, et al.
Published: (2025)

Efficient Detection of LLM-generated Texts with a Bayesian Surrogate Model
by: Miao, Yibo, et al.
Published: (2023)

Federated Learning of Dynamic Bayesian Network via Continuous Optimization from Time Series Data
by: Chen, Jianhong, et al.
Published: (2024)

Manifold Sampling via Entropy Maximization
by: Braun, Cornelius V., et al.
Published: (2026)

MoxE: Mixture of xLSTM Experts with Entropy-Aware Routing for Efficient Language Modeling
by: Thiombiano, Abdoul Majid O., et al.
Published: (2025)

Ratio Divergence Learning Using Target Energy in Restricted Boltzmann Machines: Beyond Kullback--Leibler Divergence Learning
by: Ishida, Yuichi, et al.
Published: (2024)

Do Efficient Transformers Really Save Computation?
by: Yang, Kai, et al.
Published: (2024)