Optimal partition of feature using Bayesian classifier

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Vishwakarma, Sanjay, Ganguly, Srinjoy
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913600261586944
author Vishwakarma, Sanjay
Ganguly, Srinjoy
author_facet Vishwakarma, Sanjay
Ganguly, Srinjoy
contents The Naive Bayesian classifier is a popular classification method employing the Bayesian paradigm. The concept of having conditional dependence among input variables sounds good in theory but can lead to a majority vote style behaviour. Achieving conditional independence is often difficult, and they introduce decision biases in the estimates. In Naive Bayes, certain features are called independent features as they have no conditional correlation or dependency when predicting a classification. In this paper, we focus on the optimal partition of features by proposing a novel technique called the Comonotone-Independence Classifier (CIBer) which is able to overcome the challenges posed by the Naive Bayes method. For different datasets, we clearly demonstrate the efficacy of our technique, where we achieve lower error rates and higher or equivalent accuracy compared to models such as Random Forests and XGBoost.
format Preprint
id arxiv_https___arxiv_org_abs_2304_14537
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Optimal partition of feature using Bayesian classifier
Vishwakarma, Sanjay
Ganguly, Srinjoy
Machine Learning
Artificial Intelligence
The Naive Bayesian classifier is a popular classification method employing the Bayesian paradigm. The concept of having conditional dependence among input variables sounds good in theory but can lead to a majority vote style behaviour. Achieving conditional independence is often difficult, and they introduce decision biases in the estimates. In Naive Bayes, certain features are called independent features as they have no conditional correlation or dependency when predicting a classification. In this paper, we focus on the optimal partition of features by proposing a novel technique called the Comonotone-Independence Classifier (CIBer) which is able to overcome the challenges posed by the Naive Bayes method. For different datasets, we clearly demonstrate the efficacy of our technique, where we achieve lower error rates and higher or equivalent accuracy compared to models such as Random Forests and XGBoost.
title Optimal partition of feature using Bayesian classifier
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2304.14537