Performance Prediction of On-NIC Network Functions with Multi-Resource Contention and Traffic Awareness

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wu, Shaofeng, Su, Qiang, Niu, Zhixiong, Xu, Hong
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916605245521920
author Wu, Shaofeng
Su, Qiang
Niu, Zhixiong
Xu, Hong
author_facet Wu, Shaofeng
Su, Qiang
Niu, Zhixiong
Xu, Hong
contents Network function (NF) offloading on SmartNICs has been widely used in modern data centers, offering benefits in host resource saving and programmability. Co-running NFs on the same SmartNICs can cause performance interference due to contention of onboard resources. To meet performance SLAs while ensuring efficient resource management, operators need mechanisms to predict NF performance under such contention. However, existing solutions lack SmartNIC-specific knowledge and exhibit limited traffic awareness, leading to poor accuracy for on-NIC NFs. This paper proposes Yala, a novel performance predictive system for on-NIC NFs. Yala builds upon the key observation that co-located NFs contend for multiple resources, including onboard accelerators and the memory subsystem. It also facilitates traffic awareness according to the behaviors of individual resources to maintain accuracy as the external traffic attributes vary. Evaluation using BlueField-2 SmartNICs shows that Yala improves the prediction accuracy by 78.8% and reduces SLA violations by 92.2% compared to state-of-the-art approaches, and enables new practical usecases.
format Preprint
id arxiv_https___arxiv_org_abs_2405_05529
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Performance Prediction of On-NIC Network Functions with Multi-Resource Contention and Traffic Awareness
Wu, Shaofeng
Su, Qiang
Niu, Zhixiong
Xu, Hong
Networking and Internet Architecture
Network function (NF) offloading on SmartNICs has been widely used in modern data centers, offering benefits in host resource saving and programmability. Co-running NFs on the same SmartNICs can cause performance interference due to contention of onboard resources. To meet performance SLAs while ensuring efficient resource management, operators need mechanisms to predict NF performance under such contention. However, existing solutions lack SmartNIC-specific knowledge and exhibit limited traffic awareness, leading to poor accuracy for on-NIC NFs. This paper proposes Yala, a novel performance predictive system for on-NIC NFs. Yala builds upon the key observation that co-located NFs contend for multiple resources, including onboard accelerators and the memory subsystem. It also facilitates traffic awareness according to the behaviors of individual resources to maintain accuracy as the external traffic attributes vary. Evaluation using BlueField-2 SmartNICs shows that Yala improves the prediction accuracy by 78.8% and reduces SLA violations by 92.2% compared to state-of-the-art approaches, and enables new practical usecases.
title Performance Prediction of On-NIC Network Functions with Multi-Resource Contention and Traffic Awareness
topic Networking and Internet Architecture
url https://arxiv.org/abs/2405.05529