Saved in:
Bibliographic Details
Main Author: Djidjev, Christie
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.06015
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913601246199808
author Djidjev, Christie
author_facet Djidjev, Christie
contents As cyber threats continue to evolve in sophistication and scale, the ability to detect anomalous network behavior has become critical for maintaining robust cybersecurity defenses. Modern cybersecurity systems face the overwhelming challenge of analyzing billions of daily network interactions to identify potential threats, making efficient and accurate anomaly detection algorithms crucial for network defense. This paper investigates the use of variations of the Isolation Forest (iForest) machine learning algorithm for detecting anomalies in internet scan data. In particular, it presents the Set-Partitioned Isolation Forest (siForest), a novel extension of the iForest method designed to detect anomalies in set-structured data. By treating instances such as sets of multiple network scans with the same IP address as cohesive units, siForest effectively addresses some challenges of analyzing complex, multidimensional datasets. Extensive experiments on synthetic datasets simulating diverse anomaly scenarios in network traffic demonstrate that siForest has the potential to outperform traditional approaches on some types of internet scan data.
format Preprint
id arxiv_https___arxiv_org_abs_2412_06015
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle siForest: Detecting Network Anomalies with Set-Structured Isolation Forest
Djidjev, Christie
Machine Learning
Cryptography and Security
As cyber threats continue to evolve in sophistication and scale, the ability to detect anomalous network behavior has become critical for maintaining robust cybersecurity defenses. Modern cybersecurity systems face the overwhelming challenge of analyzing billions of daily network interactions to identify potential threats, making efficient and accurate anomaly detection algorithms crucial for network defense. This paper investigates the use of variations of the Isolation Forest (iForest) machine learning algorithm for detecting anomalies in internet scan data. In particular, it presents the Set-Partitioned Isolation Forest (siForest), a novel extension of the iForest method designed to detect anomalies in set-structured data. By treating instances such as sets of multiple network scans with the same IP address as cohesive units, siForest effectively addresses some challenges of analyzing complex, multidimensional datasets. Extensive experiments on synthetic datasets simulating diverse anomaly scenarios in network traffic demonstrate that siForest has the potential to outperform traditional approaches on some types of internet scan data.
title siForest: Detecting Network Anomalies with Set-Structured Isolation Forest
topic Machine Learning
Cryptography and Security
url https://arxiv.org/abs/2412.06015