Saved in:
Bibliographic Details
Main Authors: Kovács, Edith Alice, Ország, Anna, Pfeifer, Dániel, Benczúr, András
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2408.15923
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929478034259968
author Kovács, Edith Alice
Ország, Anna
Pfeifer, Dániel
Benczúr, András
author_facet Kovács, Edith Alice
Ország, Anna
Pfeifer, Dániel
Benczúr, András
contents In this paper we introduce the so-called Generalized Naive Bayes structure as an extension of the Naive Bayes structure. We give a new greedy algorithm that finds a good fitting Generalized Naive Bayes (GNB) probability distribution. We prove that this fits the data at least as well as the probability distribution determined by the classical Naive Bayes (NB). Then, under a not very restrictive condition, we give a second algorithm for which we can prove that it finds the optimal GNB probability distribution, i.e. best fitting structure in the sense of KL divergence. Both algorithms are constructed to maximize the information content and aim to minimize redundancy. Based on these algorithms, new methods for feature selection are introduced. We discuss the similarities and differences to other related algorithms in terms of structure, methodology, and complexity. Experimental results show, that the algorithms introduced outperform the related algorithms in many cases.
format Preprint
id arxiv_https___arxiv_org_abs_2408_15923
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generalized Naive Bayes
Kovács, Edith Alice
Ország, Anna
Pfeifer, Dániel
Benczúr, András
Machine Learning
62C12, 62C10, 62-07
In this paper we introduce the so-called Generalized Naive Bayes structure as an extension of the Naive Bayes structure. We give a new greedy algorithm that finds a good fitting Generalized Naive Bayes (GNB) probability distribution. We prove that this fits the data at least as well as the probability distribution determined by the classical Naive Bayes (NB). Then, under a not very restrictive condition, we give a second algorithm for which we can prove that it finds the optimal GNB probability distribution, i.e. best fitting structure in the sense of KL divergence. Both algorithms are constructed to maximize the information content and aim to minimize redundancy. Based on these algorithms, new methods for feature selection are introduced. We discuss the similarities and differences to other related algorithms in terms of structure, methodology, and complexity. Experimental results show, that the algorithms introduced outperform the related algorithms in many cases.
title Generalized Naive Bayes
topic Machine Learning
62C12, 62C10, 62-07
url https://arxiv.org/abs/2408.15923