Explainable AI for Comparative Analysis of Intrusion Detection Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Corea, Pap M., Liu, Yongxin, Wang, Jian, Niu, Shuteng, Song, Houbing
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929407632867328
author Corea, Pap M.
Liu, Yongxin
Wang, Jian
Niu, Shuteng
Song, Houbing
author_facet Corea, Pap M.
Liu, Yongxin
Wang, Jian
Niu, Shuteng
Song, Houbing
contents Explainable Artificial Intelligence (XAI) has become a widely discussed topic, the related technologies facilitate better understanding of conventional black-box models like Random Forest, Neural Networks and etc. However, domain-specific applications of XAI are still insufficient. To fill this gap, this research analyzes various machine learning models to the tasks of binary and multi-class classification for intrusion detection from network traffic on the same dataset using occlusion sensitivity. The models evaluated include Linear Regression, Logistic Regression, Linear Support Vector Machine (SVM), K-Nearest Neighbors (KNN), Random Forest, Decision Trees, and Multi-Layer Perceptrons (MLP). We trained all models to the accuracy of 90\% on the UNSW-NB15 Dataset. We found that most classifiers leverage only less than three critical features to achieve such accuracies, indicating that effective feature engineering could actually be far more important for intrusion detection than applying complicated models. We also discover that Random Forest provides the best performance in terms of accuracy, time efficiency and robustness. Data and code available at https://github.com/pcwhy/XML-IntrusionDetection.git
format Preprint
id arxiv_https___arxiv_org_abs_2406_09684
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Explainable AI for Comparative Analysis of Intrusion Detection Models
Corea, Pap M.
Liu, Yongxin
Wang, Jian
Niu, Shuteng
Song, Houbing
Machine Learning
Artificial Intelligence
Cryptography and Security
Explainable Artificial Intelligence (XAI) has become a widely discussed topic, the related technologies facilitate better understanding of conventional black-box models like Random Forest, Neural Networks and etc. However, domain-specific applications of XAI are still insufficient. To fill this gap, this research analyzes various machine learning models to the tasks of binary and multi-class classification for intrusion detection from network traffic on the same dataset using occlusion sensitivity. The models evaluated include Linear Regression, Logistic Regression, Linear Support Vector Machine (SVM), K-Nearest Neighbors (KNN), Random Forest, Decision Trees, and Multi-Layer Perceptrons (MLP). We trained all models to the accuracy of 90\% on the UNSW-NB15 Dataset. We found that most classifiers leverage only less than three critical features to achieve such accuracies, indicating that effective feature engineering could actually be far more important for intrusion detection than applying complicated models. We also discover that Random Forest provides the best performance in terms of accuracy, time efficiency and robustness. Data and code available at https://github.com/pcwhy/XML-IntrusionDetection.git
title Explainable AI for Comparative Analysis of Intrusion Detection Models
topic Machine Learning
Artificial Intelligence
Cryptography and Security
url https://arxiv.org/abs/2406.09684