Salvato in:
Dettagli Bibliografici
Autori principali: Yang, Junhai, Li, Fenghua, Zhang, Yixuan, Zhang, Junhao, Fang, Liang, Guo, Yunchuan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:https://arxiv.org/abs/2412.02540
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909414188908544
author Yang, Junhai
Li, Fenghua
Zhang, Yixuan
Zhang, Junhao
Fang, Liang
Guo, Yunchuan
author_facet Yang, Junhai
Li, Fenghua
Zhang, Yixuan
Zhang, Junhao
Fang, Liang
Guo, Yunchuan
contents Protocol Reverse Engineering (PRE) is used to analyze protocols by inferring their structure and behavior. However, current PRE methods mainly focus on field identification within a single protocol and neglect Protocol State Machine (PSM) analysis in mixed protocol environments. This results in insufficient analysis of protocols' abnormal behavior and potential vulnerabilities, which are crucial for detecting and defending against new attack patterns. To address these challenges, we propose an automatic PSM inference framework for unknown protocols, including a fuzzy membership-based auto-converging DBSCAN algorithm for protocol format clustering, followed by a session clustering algorithm based on Needleman-Wunsch and K-Medoids algorithms to classify sessions by protocol type. Finally, we refine a probabilistic PSM algorithm to infer protocol states and the transition conditions between these states. Experimental results show that, compared with existing PRE techniques, our method can infer PSMs while enabling more precise classification of protocols.
format Preprint
id arxiv_https___arxiv_org_abs_2412_02540
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automatic State Machine Inference for Binary Protocol Reverse Engineering
Yang, Junhai
Li, Fenghua
Zhang, Yixuan
Zhang, Junhao
Fang, Liang
Guo, Yunchuan
Cryptography and Security
Protocol Reverse Engineering (PRE) is used to analyze protocols by inferring their structure and behavior. However, current PRE methods mainly focus on field identification within a single protocol and neglect Protocol State Machine (PSM) analysis in mixed protocol environments. This results in insufficient analysis of protocols' abnormal behavior and potential vulnerabilities, which are crucial for detecting and defending against new attack patterns. To address these challenges, we propose an automatic PSM inference framework for unknown protocols, including a fuzzy membership-based auto-converging DBSCAN algorithm for protocol format clustering, followed by a session clustering algorithm based on Needleman-Wunsch and K-Medoids algorithms to classify sessions by protocol type. Finally, we refine a probabilistic PSM algorithm to infer protocol states and the transition conditions between these states. Experimental results show that, compared with existing PRE techniques, our method can infer PSMs while enabling more precise classification of protocols.
title Automatic State Machine Inference for Binary Protocol Reverse Engineering
topic Cryptography and Security
url https://arxiv.org/abs/2412.02540