Network Anomaly Detection in Distributed Edge Computing Infrastructure

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Marfo, William, Rico, Enrique A., Tosh, Deepak K., Moore, Shirley V.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913725089316864
author Marfo, William
Rico, Enrique A.
Tosh, Deepak K.
Moore, Shirley V.
author_facet Marfo, William
Rico, Enrique A.
Tosh, Deepak K.
Moore, Shirley V.
contents As networks continue to grow in complexity and scale, detecting anomalies has become increasingly challenging, particularly in diverse and geographically dispersed environments. Traditional approaches often struggle with managing the computational burden associated with analyzing large-scale network traffic to identify anomalies. This paper introduces a distributed edge computing framework that integrates federated learning with Apache Spark and Kubernetes to address these challenges. We hypothesize that our approach, which enables collaborative model training across distributed nodes, significantly enhances the detection accuracy of network anomalies across different network types. By leveraging distributed computing and containerization technologies, our framework not only improves scalability and fault tolerance but also achieves superior detection performance compared to state-of-the-art methods. Extensive experiments on the UNSW-NB15 and ROAD datasets validate the effectiveness of our approach, demonstrating statistically significant improvements in detection accuracy and training efficiency over baseline models, as confirmed by Mann-Whitney U and Kolmogorov-Smirnov tests (p < 0.05).
format Preprint
id arxiv_https___arxiv_org_abs_2503_05700
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Network Anomaly Detection in Distributed Edge Computing Infrastructure
Marfo, William
Rico, Enrique A.
Tosh, Deepak K.
Moore, Shirley V.
Distributed, Parallel, and Cluster Computing
Networking and Internet Architecture
As networks continue to grow in complexity and scale, detecting anomalies has become increasingly challenging, particularly in diverse and geographically dispersed environments. Traditional approaches often struggle with managing the computational burden associated with analyzing large-scale network traffic to identify anomalies. This paper introduces a distributed edge computing framework that integrates federated learning with Apache Spark and Kubernetes to address these challenges. We hypothesize that our approach, which enables collaborative model training across distributed nodes, significantly enhances the detection accuracy of network anomalies across different network types. By leveraging distributed computing and containerization technologies, our framework not only improves scalability and fault tolerance but also achieves superior detection performance compared to state-of-the-art methods. Extensive experiments on the UNSW-NB15 and ROAD datasets validate the effectiveness of our approach, demonstrating statistically significant improvements in detection accuracy and training efficiency over baseline models, as confirmed by Mann-Whitney U and Kolmogorov-Smirnov tests (p < 0.05).
title Network Anomaly Detection in Distributed Edge Computing Infrastructure
topic Distributed, Parallel, and Cluster Computing
Networking and Internet Architecture
url https://arxiv.org/abs/2503.05700