Addressing Class Imbalance with Probabilistic Graphical Models and Variational Inference

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lou, Yujia, Liu, Jie, Sheng, Yuan, Wang, Jiawei, Zhang, Yiwei, Ren, Yaokun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916678564052992
author Lou, Yujia
Liu, Jie
Sheng, Yuan
Wang, Jiawei
Zhang, Yiwei
Ren, Yaokun
author_facet Lou, Yujia
Liu, Jie
Sheng, Yuan
Wang, Jiawei
Zhang, Yiwei
Ren, Yaokun
contents This study proposes a method for imbalanced data classification based on deep probabilistic graphical models (DPGMs) to solve the problem that traditional methods have insufficient learning ability for minority class samples. To address the classification bias caused by class imbalance, we introduce variational inference optimization probability modeling, which enables the model to adaptively adjust the representation ability of minority classes and combines the class-aware weight adjustment strategy to enhance the classifier's sensitivity to minority classes. In addition, we combine the adversarial learning mechanism to generate minority class samples in the latent space so that the model can better characterize the category boundary in the high-dimensional feature space. The experiment is evaluated on the Kaggle "Credit Card Fraud Detection" dataset and compared with a variety of advanced imbalanced classification methods (such as GAN-based sampling, BRF, XGBoost-Cost Sensitive, SAAD, HAN). The results show that the method in this study has achieved the best performance in AUC, Precision, Recall and F1-score indicators, effectively improving the recognition rate of minority classes and reducing the false alarm rate. This method can be widely used in imbalanced classification tasks such as financial fraud detection, medical diagnosis, and anomaly detection, providing a new solution for related research.
format Preprint
id arxiv_https___arxiv_org_abs_2504_05758
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Addressing Class Imbalance with Probabilistic Graphical Models and Variational Inference
Lou, Yujia
Liu, Jie
Sheng, Yuan
Wang, Jiawei
Zhang, Yiwei
Ren, Yaokun
Machine Learning
This study proposes a method for imbalanced data classification based on deep probabilistic graphical models (DPGMs) to solve the problem that traditional methods have insufficient learning ability for minority class samples. To address the classification bias caused by class imbalance, we introduce variational inference optimization probability modeling, which enables the model to adaptively adjust the representation ability of minority classes and combines the class-aware weight adjustment strategy to enhance the classifier's sensitivity to minority classes. In addition, we combine the adversarial learning mechanism to generate minority class samples in the latent space so that the model can better characterize the category boundary in the high-dimensional feature space. The experiment is evaluated on the Kaggle "Credit Card Fraud Detection" dataset and compared with a variety of advanced imbalanced classification methods (such as GAN-based sampling, BRF, XGBoost-Cost Sensitive, SAAD, HAN). The results show that the method in this study has achieved the best performance in AUC, Precision, Recall and F1-score indicators, effectively improving the recognition rate of minority classes and reducing the false alarm rate. This method can be widely used in imbalanced classification tasks such as financial fraud detection, medical diagnosis, and anomaly detection, providing a new solution for related research.
title Addressing Class Imbalance with Probabilistic Graphical Models and Variational Inference
topic Machine Learning
url https://arxiv.org/abs/2504.05758