Cora: Accelerating Stateful Network Applications with SmartNICs
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917821810737152 |
|---|---|
| author | Xi, Shaoke Gao, Jiaqi Liu, Mengqi Cao, Jiamin Li, Fuliang Bu, Kai Ren, Kui Yu, Minlan Cai, Dennis Zhai, Ennan |
| author_facet | Xi, Shaoke Gao, Jiaqi Liu, Mengqi Cao, Jiamin Li, Fuliang Bu, Kai Ren, Kui Yu, Minlan Cai, Dennis Zhai, Ennan |
| contents | With the growing performance requirements on networked applications, there is a new trend of offloading stateful network applications to SmartNICs to improve performance and reduce the total cost of ownership. However, offloading stateful network applications is non-trivial due to state operation complexity, state resource consumption, and the complicated relationship between traffic and state. Naively partitioning the program by state or traffic can result in a suboptimal partition plan with higher CPU usage or even packet drops. In this paper, we propose Cora, a compiler and runtime that offloads stateful network applications to SmartNIC-accelerated hosts. Cora compiler introduces an accurate performance model for each SmartNIC and employs an efficient compiling algorithm to search the offloading plan. Cora runtime can monitor traffic dynamics and adapt to minimize CPU usage. Cora is built atop Netronome Agilio and BlueField 2 SmartNICs. Our evaluation shows that for the same throughput target, Cora can propose partition plans saving up to 94.0% CPU cores, 1.9 times more than baseline solutions. Under the same resource constraint, Cora can accelerate network functions by 44.9%-82.3%. Cora runtime can adapt to traffic changes and keep CPU usage low. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_22229 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Cora: Accelerating Stateful Network Applications with SmartNICs Xi, Shaoke Gao, Jiaqi Liu, Mengqi Cao, Jiamin Li, Fuliang Bu, Kai Ren, Kui Yu, Minlan Cai, Dennis Zhai, Ennan Networking and Internet Architecture Computation and Language With the growing performance requirements on networked applications, there is a new trend of offloading stateful network applications to SmartNICs to improve performance and reduce the total cost of ownership. However, offloading stateful network applications is non-trivial due to state operation complexity, state resource consumption, and the complicated relationship between traffic and state. Naively partitioning the program by state or traffic can result in a suboptimal partition plan with higher CPU usage or even packet drops. In this paper, we propose Cora, a compiler and runtime that offloads stateful network applications to SmartNIC-accelerated hosts. Cora compiler introduces an accurate performance model for each SmartNIC and employs an efficient compiling algorithm to search the offloading plan. Cora runtime can monitor traffic dynamics and adapt to minimize CPU usage. Cora is built atop Netronome Agilio and BlueField 2 SmartNICs. Our evaluation shows that for the same throughput target, Cora can propose partition plans saving up to 94.0% CPU cores, 1.9 times more than baseline solutions. Under the same resource constraint, Cora can accelerate network functions by 44.9%-82.3%. Cora runtime can adapt to traffic changes and keep CPU usage low. |
| title | Cora: Accelerating Stateful Network Applications with SmartNICs |
| topic | Networking and Internet Architecture Computation and Language |
| url | https://arxiv.org/abs/2410.22229 |