One task to rule them all: A closer look at traffic classification generalizability

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Akbari, Elham, Zhou, Zihao, Salahuddin, Mohammad Ali, Limam, Noura, Boutaba, Raouf, Mathieu, Bertrand, Moteau, Stephanie, Tuffin, Stephane
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908441624182784
author Akbari, Elham
Zhou, Zihao
Salahuddin, Mohammad Ali
Limam, Noura
Boutaba, Raouf
Mathieu, Bertrand
Moteau, Stephanie
Tuffin, Stephane
author_facet Akbari, Elham
Zhou, Zihao
Salahuddin, Mohammad Ali
Limam, Noura
Boutaba, Raouf
Mathieu, Bertrand
Moteau, Stephanie
Tuffin, Stephane
contents Existing website fingerprinting and traffic classification solutions do not work well when the evaluation context changes, as their performances often heavily rely on context-specific assumptions. To clarify this problem, we take three prior solutions presented for different but similar traffic classification and website fingerprinting tasks, and apply each solution's model to another solution's dataset. We pinpoint dataset-specific and model-specific properties that lead each of them to overperform in their specific evaluation context. As a realistic evaluation context that takes practical labeling constraints into account, we design an evaluation framework using two recent real-world TLS traffic datasets from large-scale networks. The framework simulates a futuristic scenario in which SNIs are hidden in some networks but not in others, and the classifier's goal is to predict destination services in one network's traffic, having been trained on a labelled dataset collected from a different network. Our framework has the distinction of including real-world distribution shift, while excluding concept drift. We show that, even when abundant labeled data is available, the best solutions' performances under distribution shift are between 30% and 40%, and a simple 1-Nearest Neighbor classifier's performance is not far behind. We depict all performances measured on different models, not just the best ones, for a fair representation of traffic models in practice.
format Preprint
id arxiv_https___arxiv_org_abs_2507_06430
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle One task to rule them all: A closer look at traffic classification generalizability
Akbari, Elham
Zhou, Zihao
Salahuddin, Mohammad Ali
Limam, Noura
Boutaba, Raouf
Mathieu, Bertrand
Moteau, Stephanie
Tuffin, Stephane
Networking and Internet Architecture
Existing website fingerprinting and traffic classification solutions do not work well when the evaluation context changes, as their performances often heavily rely on context-specific assumptions. To clarify this problem, we take three prior solutions presented for different but similar traffic classification and website fingerprinting tasks, and apply each solution's model to another solution's dataset. We pinpoint dataset-specific and model-specific properties that lead each of them to overperform in their specific evaluation context. As a realistic evaluation context that takes practical labeling constraints into account, we design an evaluation framework using two recent real-world TLS traffic datasets from large-scale networks. The framework simulates a futuristic scenario in which SNIs are hidden in some networks but not in others, and the classifier's goal is to predict destination services in one network's traffic, having been trained on a labelled dataset collected from a different network. Our framework has the distinction of including real-world distribution shift, while excluding concept drift. We show that, even when abundant labeled data is available, the best solutions' performances under distribution shift are between 30% and 40%, and a simple 1-Nearest Neighbor classifier's performance is not far behind. We depict all performances measured on different models, not just the best ones, for a fair representation of traffic models in practice.
title One task to rule them all: A closer look at traffic classification generalizability
topic Networking and Internet Architecture
url https://arxiv.org/abs/2507.06430