FitNets: An Adaptive Framework to Learn Accurate Traffic Distributions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Dietmüller, Alexander, Alcoz, Albert Gran, Vanbever, Laurent
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910458545438720
author Dietmüller, Alexander
Alcoz, Albert Gran
Vanbever, Laurent
author_facet Dietmüller, Alexander
Alcoz, Albert Gran
Vanbever, Laurent
contents Learning precise distributions of traffic features (e.g., burst sizes, packet inter-arrival time) is still a largely unsolved problem despite being critical for management tasks such as capacity planning or anomaly detection. A key limitation nowadays is the lack of feedback between the control plane and the data plane. Programmable data planes offer the opportunity to create systems that let data- and control plane to work together, compensating their respective shortcomings. We present FitNets, an adaptive network monitoring system leveraging feedback between the data- and the control plane to learn accurate traffic distributions. In the control plane, FitNets relies on Kernel Density Estimators which allow to provably learn distributions of any shape. In the data plane, FitNets tests the accuracy of the learned distributions while dynamically adapting data collection to the observed distribution fitness, prioritizing under-fitted features. We have implemented FitNets in Python and P4 (including on commercially available programmable switches) and tested it on real and synthetic traffic traces. FitNets is practical: it is able to estimate hundreds of distributions from up to 60 millions samples per second, while providing accurate error estimates and adapting to complex traffic patterns.
format Preprint
id arxiv_https___arxiv_org_abs_2405_10931
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle FitNets: An Adaptive Framework to Learn Accurate Traffic Distributions
Dietmüller, Alexander
Alcoz, Albert Gran
Vanbever, Laurent
Networking and Internet Architecture
Learning precise distributions of traffic features (e.g., burst sizes, packet inter-arrival time) is still a largely unsolved problem despite being critical for management tasks such as capacity planning or anomaly detection. A key limitation nowadays is the lack of feedback between the control plane and the data plane. Programmable data planes offer the opportunity to create systems that let data- and control plane to work together, compensating their respective shortcomings. We present FitNets, an adaptive network monitoring system leveraging feedback between the data- and the control plane to learn accurate traffic distributions. In the control plane, FitNets relies on Kernel Density Estimators which allow to provably learn distributions of any shape. In the data plane, FitNets tests the accuracy of the learned distributions while dynamically adapting data collection to the observed distribution fitness, prioritizing under-fitted features. We have implemented FitNets in Python and P4 (including on commercially available programmable switches) and tested it on real and synthetic traffic traces. FitNets is practical: it is able to estimate hundreds of distributions from up to 60 millions samples per second, while providing accurate error estimates and adapting to complex traffic patterns.
title FitNets: An Adaptive Framework to Learn Accurate Traffic Distributions
topic Networking and Internet Architecture
url https://arxiv.org/abs/2405.10931