Salvato in:
Dettagli Bibliografici
Autori principali: Tan, Zhuoran, Wang, Qiyuan, Anagnostopoulos, Christos, Parambath, Shameem P., Singer, Jeremy, Temple, Sam
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2504.02322
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915225295388672
author Tan, Zhuoran
Wang, Qiyuan
Anagnostopoulos, Christos
Parambath, Shameem P.
Singer, Jeremy
Temple, Sam
author_facet Tan, Zhuoran
Wang, Qiyuan
Anagnostopoulos, Christos
Parambath, Shameem P.
Singer, Jeremy
Temple, Sam
contents Effective anomaly detection from logs is crucial for enhancing cybersecurity defenses by enabling the early identification of threats. Despite advances in anomaly detection, existing systems often fall short in areas such as post-detection validation, scalability, and effective maintenance. These limitations not only hinder the detection of new threats but also impair overall system performance. To address these challenges, we propose CEDLog, a novel practical framework that integrates Elastic Weight Consolidation (EWC) for continual learning and implements distributed computing for scalable processing by integrating Apache Airflow and Dask. In CEDLog, anomalies are detected through the synthesis of Multi-layer Perceptron (MLP) and Graph Convolutional Networks (GCNs) using critical features present in event logs. Through comparisons with update strategies on large-scale datasets, we demonstrate the strengths of CEDLog, showcasing efficient updates and low false positives
format Preprint
id arxiv_https___arxiv_org_abs_2504_02322
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Distributed Log-driven Anomaly Detection System based on Evolving Decision Making
Tan, Zhuoran
Wang, Qiyuan
Anagnostopoulos, Christos
Parambath, Shameem P.
Singer, Jeremy
Temple, Sam
Cryptography and Security
Distributed, Parallel, and Cluster Computing
Effective anomaly detection from logs is crucial for enhancing cybersecurity defenses by enabling the early identification of threats. Despite advances in anomaly detection, existing systems often fall short in areas such as post-detection validation, scalability, and effective maintenance. These limitations not only hinder the detection of new threats but also impair overall system performance. To address these challenges, we propose CEDLog, a novel practical framework that integrates Elastic Weight Consolidation (EWC) for continual learning and implements distributed computing for scalable processing by integrating Apache Airflow and Dask. In CEDLog, anomalies are detected through the synthesis of Multi-layer Perceptron (MLP) and Graph Convolutional Networks (GCNs) using critical features present in event logs. Through comparisons with update strategies on large-scale datasets, we demonstrate the strengths of CEDLog, showcasing efficient updates and low false positives
title Distributed Log-driven Anomaly Detection System based on Evolving Decision Making
topic Cryptography and Security
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2504.02322