MalMoE: Mixture-of-Experts Enhanced Encrypted Malicious Traffic Detection Under Graph Drift

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Tan, Yunpeng, Li, Qingyang, Yang, Mingxin, Hu, Yannan, Zhang, Lei, Zhang, Xinggong
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910018500034560
author Tan, Yunpeng
Li, Qingyang
Yang, Mingxin
Hu, Yannan
Zhang, Lei
Zhang, Xinggong
author_facet Tan, Yunpeng
Li, Qingyang
Yang, Mingxin
Hu, Yannan
Zhang, Lei
Zhang, Xinggong
contents Encryption has been commonly used in network traffic to secure transmission, but it also brings challenges for malicious traffic detection, due to the invisibility of the packet payload. Graph-based methods are emerging as promising solutions by leveraging multi-host interactions to promote detection accuracy. But most of them face a critical problem: Graph Drift, where the flow statistics or topological information of a graph change over time. To overcome these drawbacks, we propose a graph-assisted encrypted traffic detection system, MalMoE, which applies Mixture of Experts (MoE) to select the best expert model for drift-aware classification. Particularly, we design 1-hop-GNN-like expert models that handle different graph drifts by analyzing graphs with different features. Then, the redesigned gate model conducts expert selection according to the actual drift. MalMoE is trained with a stable two-stage training strategy with data augmentation, which effectively guides the gate on how to perform routing. Experiments on open-source, synthetic, and real-world datasets show that MalMoE can perform precise and real-time detection.
format Preprint
id arxiv_https___arxiv_org_abs_2602_10157
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MalMoE: Mixture-of-Experts Enhanced Encrypted Malicious Traffic Detection Under Graph Drift
Tan, Yunpeng
Li, Qingyang
Yang, Mingxin
Hu, Yannan
Zhang, Lei
Zhang, Xinggong
Cryptography and Security
Artificial Intelligence
Networking and Internet Architecture
Encryption has been commonly used in network traffic to secure transmission, but it also brings challenges for malicious traffic detection, due to the invisibility of the packet payload. Graph-based methods are emerging as promising solutions by leveraging multi-host interactions to promote detection accuracy. But most of them face a critical problem: Graph Drift, where the flow statistics or topological information of a graph change over time. To overcome these drawbacks, we propose a graph-assisted encrypted traffic detection system, MalMoE, which applies Mixture of Experts (MoE) to select the best expert model for drift-aware classification. Particularly, we design 1-hop-GNN-like expert models that handle different graph drifts by analyzing graphs with different features. Then, the redesigned gate model conducts expert selection according to the actual drift. MalMoE is trained with a stable two-stage training strategy with data augmentation, which effectively guides the gate on how to perform routing. Experiments on open-source, synthetic, and real-world datasets show that MalMoE can perform precise and real-time detection.
title MalMoE: Mixture-of-Experts Enhanced Encrypted Malicious Traffic Detection Under Graph Drift
topic Cryptography and Security
Artificial Intelligence
Networking and Internet Architecture
url https://arxiv.org/abs/2602.10157