Multi-agent Reinforcement Learning-based Network Intrusion Detection System

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Tellache, Amine, Mokhtari, Amdjed, Korba, Abdelaziz Amara, Ghamri-Doudane, Yacine
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913420960333824
author Tellache, Amine
Mokhtari, Amdjed
Korba, Abdelaziz Amara
Ghamri-Doudane, Yacine
author_facet Tellache, Amine
Mokhtari, Amdjed
Korba, Abdelaziz Amara
Ghamri-Doudane, Yacine
contents Intrusion Detection Systems (IDS) play a crucial role in ensuring the security of computer networks. Machine learning has emerged as a popular approach for intrusion detection due to its ability to analyze and detect patterns in large volumes of data. However, current ML-based IDS solutions often struggle to keep pace with the ever-changing nature of attack patterns and the emergence of new attack types. Additionally, these solutions face challenges related to class imbalance, where the number of instances belonging to different classes (normal and intrusions) is significantly imbalanced, which hinders their ability to effectively detect minor classes. In this paper, we propose a novel multi-agent reinforcement learning (RL) architecture, enabling automatic, efficient, and robust network intrusion detection. To enhance the capabilities of the proposed model, we have improved the DQN algorithm by implementing the weighted mean square loss function and employing cost-sensitive learning techniques. Our solution introduces a resilient architecture designed to accommodate the addition of new attacks and effectively adapt to changes in existing attack patterns. Experimental results realized using CIC-IDS-2017 dataset, demonstrate that our approach can effectively handle the class imbalance problem and provide a fine grained classification of attacks with a very low false positive rate. In comparison to the current state-of-the-art works, our solution demonstrates a significant superiority in both detection rate and false positive rate.
format Preprint
id arxiv_https___arxiv_org_abs_2407_05766
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multi-agent Reinforcement Learning-based Network Intrusion Detection System
Tellache, Amine
Mokhtari, Amdjed
Korba, Abdelaziz Amara
Ghamri-Doudane, Yacine
Cryptography and Security
Artificial Intelligence
Intrusion Detection Systems (IDS) play a crucial role in ensuring the security of computer networks. Machine learning has emerged as a popular approach for intrusion detection due to its ability to analyze and detect patterns in large volumes of data. However, current ML-based IDS solutions often struggle to keep pace with the ever-changing nature of attack patterns and the emergence of new attack types. Additionally, these solutions face challenges related to class imbalance, where the number of instances belonging to different classes (normal and intrusions) is significantly imbalanced, which hinders their ability to effectively detect minor classes. In this paper, we propose a novel multi-agent reinforcement learning (RL) architecture, enabling automatic, efficient, and robust network intrusion detection. To enhance the capabilities of the proposed model, we have improved the DQN algorithm by implementing the weighted mean square loss function and employing cost-sensitive learning techniques. Our solution introduces a resilient architecture designed to accommodate the addition of new attacks and effectively adapt to changes in existing attack patterns. Experimental results realized using CIC-IDS-2017 dataset, demonstrate that our approach can effectively handle the class imbalance problem and provide a fine grained classification of attacks with a very low false positive rate. In comparison to the current state-of-the-art works, our solution demonstrates a significant superiority in both detection rate and false positive rate.
title Multi-agent Reinforcement Learning-based Network Intrusion Detection System
topic Cryptography and Security
Artificial Intelligence
url https://arxiv.org/abs/2407.05766