Towards a Transformer-Based Pre-trained Model for IoT Traffic Classification
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866914889779380224 |
|---|---|
| author | Bazaluk, Bruna Hamdan, Mosab Ghaleb, Mustafa Gismalla, Mohammed S. M. da Silva, Flavio S. Correa Batista, Daniel Macêdo |
| author_facet | Bazaluk, Bruna Hamdan, Mosab Ghaleb, Mustafa Gismalla, Mohammed S. M. da Silva, Flavio S. Correa Batista, Daniel Macêdo |
| contents | The classification of IoT traffic is important to improve the efficiency and security of IoT-based networks. As the state-of-the-art classification methods are based on Deep Learning, most of the current results require a large amount of data to be trained. Thereby, in real-life situations, where there is a scarce amount of IoT traffic data, the models would not perform so well. Consequently, these models underperform outside their initial training conditions and fail to capture the complex characteristics of network traffic, rendering them inefficient and unreliable in real-world applications. In this paper, we propose IoT Traffic Classification Transformer (ITCT), a novel approach that utilizes the state-of-the-art transformer-based model named TabTransformer. ITCT, which is pre-trained on a large labeled MQTT-based IoT traffic dataset and may be fine-tuned with a small set of labeled data, showed promising results in various traffic classification tasks. Our experiments demonstrated that the ITCT model significantly outperforms existing models, achieving an overall accuracy of 82%. To support reproducibility and collaborative development, all associated code has been made publicly available. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_19051 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards a Transformer-Based Pre-trained Model for IoT Traffic Classification Bazaluk, Bruna Hamdan, Mosab Ghaleb, Mustafa Gismalla, Mohammed S. M. da Silva, Flavio S. Correa Batista, Daniel Macêdo Networking and Internet Architecture Artificial Intelligence The classification of IoT traffic is important to improve the efficiency and security of IoT-based networks. As the state-of-the-art classification methods are based on Deep Learning, most of the current results require a large amount of data to be trained. Thereby, in real-life situations, where there is a scarce amount of IoT traffic data, the models would not perform so well. Consequently, these models underperform outside their initial training conditions and fail to capture the complex characteristics of network traffic, rendering them inefficient and unreliable in real-world applications. In this paper, we propose IoT Traffic Classification Transformer (ITCT), a novel approach that utilizes the state-of-the-art transformer-based model named TabTransformer. ITCT, which is pre-trained on a large labeled MQTT-based IoT traffic dataset and may be fine-tuned with a small set of labeled data, showed promising results in various traffic classification tasks. Our experiments demonstrated that the ITCT model significantly outperforms existing models, achieving an overall accuracy of 82%. To support reproducibility and collaborative development, all associated code has been made publicly available. |
| title | Towards a Transformer-Based Pre-trained Model for IoT Traffic Classification |
| topic | Networking and Internet Architecture Artificial Intelligence |
| url | https://arxiv.org/abs/2407.19051 |