Entropy and the Kullback-Leibler Divergence for Bayesian Networks: Computational Complexity and Efficient Implementation
Fuente:
arXiv
Guardado en:
| Autor principal: | Scutari, Marco |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Generalized Kullback-Leibler Divergence Loss
por: Cui, Jiequan, et al.
Publicado: (2025)
por: Cui, Jiequan, et al.
Publicado: (2025)
Better Estimation of the Kullback--Leibler Divergence Between Language Models
por: Amini, Afra, et al.
Publicado: (2025)
por: Amini, Afra, et al.
Publicado: (2025)
Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
por: Lv, Jiaming, et al.
Publicado: (2024)
por: Lv, Jiaming, et al.
Publicado: (2024)
Diversity-Aware Reverse Kullback-Leibler Divergence for Large Language Model Distillation
por: Luong, Hoang-Chau, et al.
Publicado: (2026)
por: Luong, Hoang-Chau, et al.
Publicado: (2026)
Decoupled Kullback-Leibler Divergence Loss
por: Cui, Jiequan, et al.
Publicado: (2023)
por: Cui, Jiequan, et al.
Publicado: (2023)
Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
por: Wu, Taiqiang, et al.
Publicado: (2024)
por: Wu, Taiqiang, et al.
Publicado: (2024)
Probabilistic classification from possibilistic data: computing Kullback-Leibler projection with a possibility distribution
por: Baaj, Ismaïl, et al.
Publicado: (2026)
por: Baaj, Ismaïl, et al.
Publicado: (2026)
Benchmarking Constraint-Based Bayesian Structure Learning Algorithms: Role of Network Topology
por: Nagarajan, Radha, et al.
Publicado: (2025)
por: Nagarajan, Radha, et al.
Publicado: (2025)
Nearly Minimax Discrete Distribution Estimation in Kullback-Leibler Divergence with High Probability
por: van der Hoeven, Dirk, et al.
Publicado: (2025)
por: van der Hoeven, Dirk, et al.
Publicado: (2025)
Bayesian Experimental Design for Model Discrepancy Calibration: A Rivalry between Kullback--Leibler Divergence and Wasserstein Distance
por: Yang, Huchen, et al.
Publicado: (2026)
por: Yang, Huchen, et al.
Publicado: (2026)
Relaxed Triangle Inequality for Kullback-Leibler Divergence Between Multivariate Gaussian Distributions
por: Xiao, Shiji, et al.
Publicado: (2026)
por: Xiao, Shiji, et al.
Publicado: (2026)
Vocabulary Expansion of Large Language Models via Kullback-Leibler-Based Self-Distillation
por: Linder, Max Rehman
Publicado: (2025)
por: Linder, Max Rehman
Publicado: (2025)
CAKD: A Correlation-Aware Knowledge Distillation Framework Based on Decoupling Kullback-Leibler Divergence
por: Zhang, Zao, et al.
Publicado: (2024)
por: Zhang, Zao, et al.
Publicado: (2024)
Connecting Jensen-Shannon and Kullback-Leibler Divergences: A New Bound for Representation Learning
por: Dorent, Reuben, et al.
Publicado: (2025)
por: Dorent, Reuben, et al.
Publicado: (2025)
The Jacobian and Hessian of the Kullback-Leibler Divergence between Multivariate Gaussian Distributions (Technical Report)
por: Maroñas, Juan
Publicado: (2025)
por: Maroñas, Juan
Publicado: (2025)
Bayesian Pseudo-Coresets via Contrastive Divergence
por: Tiwary, Piyush, et al.
Publicado: (2023)
por: Tiwary, Piyush, et al.
Publicado: (2023)
On the Computational Capability of Graph Neural Networks: A Circuit Complexity Bound Perspective
por: Li, Xiaoyu, et al.
Publicado: (2025)
por: Li, Xiaoyu, et al.
Publicado: (2025)
Risk Bounds for Mixture Density Estimation on Compact Domains via the $h$-Lifted Kullback--Leibler Divergence
por: Chong, Mark Chiu, et al.
Publicado: (2024)
por: Chong, Mark Chiu, et al.
Publicado: (2024)
Differentiable Annealed Importance Sampling Minimizes The Symmetrized Kullback-Leibler Divergence Between Initial and Target Distribution
por: Zenn, Johannes, et al.
Publicado: (2024)
por: Zenn, Johannes, et al.
Publicado: (2024)
Entropy Meets Importance: A Unified Head Importance-Entropy Score for Stable and Efficient Transformer Pruning
por: Choi, Minsik, et al.
Publicado: (2025)
por: Choi, Minsik, et al.
Publicado: (2025)
Kullback-Leibler Barycentre of Stochastic Processes
por: Jaimungal, Sebastian, et al.
Publicado: (2024)
por: Jaimungal, Sebastian, et al.
Publicado: (2024)
Native Fortran Implementation of TensorFlow-Trained Deep and Bayesian Neural Networks
por: Furlong, Aidan, et al.
Publicado: (2025)
por: Furlong, Aidan, et al.
Publicado: (2025)
Entropy Adaptive Decoding: Dynamic Model Switching for Efficient Inference
por: Simonds, Toby
Publicado: (2025)
por: Simonds, Toby
Publicado: (2025)
A Note on Bayesian Networks with Latent Root Variables
por: Zaffalon, Marco, et al.
Publicado: (2024)
por: Zaffalon, Marco, et al.
Publicado: (2024)
Scaling Stick-Breaking Attention: An Efficient Implementation and In-depth Study
por: Tan, Shawn, et al.
Publicado: (2024)
por: Tan, Shawn, et al.
Publicado: (2024)
A note on the unique properties of the Kullback--Leibler divergence for sampling via gradient flows
por: Crucinio, Francesca Romana
Publicado: (2025)
por: Crucinio, Francesca Romana
Publicado: (2025)
Understanding and Improving Shampoo and SOAP via Kullback-Leibler Minimization
por: Lin, Wu, et al.
Publicado: (2025)
por: Lin, Wu, et al.
Publicado: (2025)
GTPO: Stabilizing Group Relative Policy Optimization via Gradient and Entropy Control
por: Simoni, Marco, et al.
Publicado: (2025)
por: Simoni, Marco, et al.
Publicado: (2025)
A Kullback-Leibler divergence method for input-system-state identification
por: Impraimakis, Marios
Publicado: (2025)
por: Impraimakis, Marios
Publicado: (2025)
Restricted Bayesian Neural Network
por: Ganguly, Sourav, et al.
Publicado: (2024)
por: Ganguly, Sourav, et al.
Publicado: (2024)
Efficient Agent Training for Computer Use
por: He, Yanheng, et al.
Publicado: (2025)
por: He, Yanheng, et al.
Publicado: (2025)
LLM Safety Alignment is Divergence Estimation in Disguise
por: Haldar, Rajdeep, et al.
Publicado: (2025)
por: Haldar, Rajdeep, et al.
Publicado: (2025)
From Overfitting to Reliability: Introducing the Hierarchical Approximate Bayesian Neural Network
por: Amirkhanian, Hayk, et al.
Publicado: (2025)
por: Amirkhanian, Hayk, et al.
Publicado: (2025)
Symbolic Foundation Regressor on Complex Networks
por: Liu, Weiting, et al.
Publicado: (2025)
por: Liu, Weiting, et al.
Publicado: (2025)
Efficient Detection of LLM-generated Texts with a Bayesian Surrogate Model
por: Miao, Yibo, et al.
Publicado: (2023)
por: Miao, Yibo, et al.
Publicado: (2023)
Federated Learning of Dynamic Bayesian Network via Continuous Optimization from Time Series Data
por: Chen, Jianhong, et al.
Publicado: (2024)
por: Chen, Jianhong, et al.
Publicado: (2024)
Manifold Sampling via Entropy Maximization
por: Braun, Cornelius V., et al.
Publicado: (2026)
por: Braun, Cornelius V., et al.
Publicado: (2026)
MoxE: Mixture of xLSTM Experts with Entropy-Aware Routing for Efficient Language Modeling
por: Thiombiano, Abdoul Majid O., et al.
Publicado: (2025)
por: Thiombiano, Abdoul Majid O., et al.
Publicado: (2025)
Ratio Divergence Learning Using Target Energy in Restricted Boltzmann Machines: Beyond Kullback--Leibler Divergence Learning
por: Ishida, Yuichi, et al.
Publicado: (2024)
por: Ishida, Yuichi, et al.
Publicado: (2024)
Do Efficient Transformers Really Save Computation?
por: Yang, Kai, et al.
Publicado: (2024)
por: Yang, Kai, et al.
Publicado: (2024)
Ejemplares similares
-
Generalized Kullback-Leibler Divergence Loss
por: Cui, Jiequan, et al.
Publicado: (2025) -
Better Estimation of the Kullback--Leibler Divergence Between Language Models
por: Amini, Afra, et al.
Publicado: (2025) -
Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation
por: Lv, Jiaming, et al.
Publicado: (2024) -
Diversity-Aware Reverse Kullback-Leibler Divergence for Large Language Model Distillation
por: Luong, Hoang-Chau, et al.
Publicado: (2026) -
Decoupled Kullback-Leibler Divergence Loss
por: Cui, Jiequan, et al.
Publicado: (2023)