Impacts of Data Preprocessing and Hyperparameter Optimization on the Performance of Machine Learning Models Applied to Intrusion Detection Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lima, Mateus Guimarães, Carvalho, Antony, Álvares, João Gabriel, Chagas, Clayton Escouper das, Goldschmidt, Ronaldo Ribeiro
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909256773533696
author Lima, Mateus Guimarães
Carvalho, Antony
Álvares, João Gabriel
Chagas, Clayton Escouper das
Goldschmidt, Ronaldo Ribeiro
author_facet Lima, Mateus Guimarães
Carvalho, Antony
Álvares, João Gabriel
Chagas, Clayton Escouper das
Goldschmidt, Ronaldo Ribeiro
contents In the context of cybersecurity of modern communications networks, Intrusion Detection Systems (IDS) have been continuously improved, many of them incorporating machine learning (ML) techniques to identify threats. Although there are researches focused on the study of these techniques applied to IDS, the state-of-the-art lacks works concentrated exclusively on the evaluation of the impacts of data pre-processing actions and the optimization of the values of the hyperparameters of the ML algorithms in the construction of the models of threat identification. This article aims to present a study that fills this research gap. For that, experiments were carried out with two data sets, comparing attack scenarios with variations of pre-processing techniques and optimization of hyperparameters. The results confirm that the proper application of these techniques, in general, makes the generated classification models more robust and greatly reduces the execution times of these models' training and testing processes.
format Preprint
id arxiv_https___arxiv_org_abs_2407_11105
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Impacts of Data Preprocessing and Hyperparameter Optimization on the Performance of Machine Learning Models Applied to Intrusion Detection Systems
Lima, Mateus Guimarães
Carvalho, Antony
Álvares, João Gabriel
Chagas, Clayton Escouper das
Goldschmidt, Ronaldo Ribeiro
Cryptography and Security
Artificial Intelligence
Machine Learning
In the context of cybersecurity of modern communications networks, Intrusion Detection Systems (IDS) have been continuously improved, many of them incorporating machine learning (ML) techniques to identify threats. Although there are researches focused on the study of these techniques applied to IDS, the state-of-the-art lacks works concentrated exclusively on the evaluation of the impacts of data pre-processing actions and the optimization of the values of the hyperparameters of the ML algorithms in the construction of the models of threat identification. This article aims to present a study that fills this research gap. For that, experiments were carried out with two data sets, comparing attack scenarios with variations of pre-processing techniques and optimization of hyperparameters. The results confirm that the proper application of these techniques, in general, makes the generated classification models more robust and greatly reduces the execution times of these models' training and testing processes.
title Impacts of Data Preprocessing and Hyperparameter Optimization on the Performance of Machine Learning Models Applied to Intrusion Detection Systems
topic Cryptography and Security
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2407.11105