Shift Detection and Adaptation for Network Intrusion Detection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Mousavipour, Ehssan, Dimanchev, Andrey, Ghaderi, Majid
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918507077173248
author Mousavipour, Ehssan
Dimanchev, Andrey
Ghaderi, Majid
author_facet Mousavipour, Ehssan
Dimanchev, Andrey
Ghaderi, Majid
contents Distribution shift, a change in the statistical properties of data over time, poses a critical challenge for deep learning anomaly detection systems. Existing anomaly detection systems often struggle to adapt to these shifts. Specifically, systems based on supervised learning require costly manual labeling, while those based on unsupervised learning rely on clean data, which is difficult to obtain, for shift adaptation. Both of these requirements are challenging to meet in practice. In this paper, we introduce NetSight, a framework for supervised anomaly detection in network data that continually detects and adapts to distribution shifts in an online manner. NetSight eliminates manual intervention through a novel pseudo-labeling technique and uses a knowledge distillation-based adaptation strategy to prevent catastrophic forgetting. Evaluated on three long-term network datasets, NetSight demonstrates superior adaptation performance compared to state-of-the-art methods that rely on manual labeling, achieving F1-score improvements of up to 11.72%. This proves its robustness and effectiveness in dynamic networks that experience distribution shifts over time.
format Preprint
id arxiv_https___arxiv_org_abs_2508_15100
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Shift Detection and Adaptation for Network Intrusion Detection
Mousavipour, Ehssan
Dimanchev, Andrey
Ghaderi, Majid
Cryptography and Security
Machine Learning
Distribution shift, a change in the statistical properties of data over time, poses a critical challenge for deep learning anomaly detection systems. Existing anomaly detection systems often struggle to adapt to these shifts. Specifically, systems based on supervised learning require costly manual labeling, while those based on unsupervised learning rely on clean data, which is difficult to obtain, for shift adaptation. Both of these requirements are challenging to meet in practice. In this paper, we introduce NetSight, a framework for supervised anomaly detection in network data that continually detects and adapts to distribution shifts in an online manner. NetSight eliminates manual intervention through a novel pseudo-labeling technique and uses a knowledge distillation-based adaptation strategy to prevent catastrophic forgetting. Evaluated on three long-term network datasets, NetSight demonstrates superior adaptation performance compared to state-of-the-art methods that rely on manual labeling, achieving F1-score improvements of up to 11.72%. This proves its robustness and effectiveness in dynamic networks that experience distribution shifts over time.
title Shift Detection and Adaptation for Network Intrusion Detection
topic Cryptography and Security
Machine Learning
url https://arxiv.org/abs/2508.15100