Meili: Enabling SmartNIC as a Service in the Cloud
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910547605192704 |
|---|---|
| author | Su, Qiang Wu, Shaofeng Niu, Zhixiong Shu, Ran Cheng, Peng Xiong, Yongqiang Liu, Zaoxing Xu, Hong |
| author_facet | Su, Qiang Wu, Shaofeng Niu, Zhixiong Shu, Ran Cheng, Peng Xiong, Yongqiang Liu, Zaoxing Xu, Hong |
| contents | SmartNICs are touted as an attractive substrate for network application offloading, offering benefits in programmability, host resource saving, and energy efficiency. The current usage restricts offloading to local hosts and confines SmartNIC ownership to individual application teams, resulting in poor resource efficiency and scalability. This paper presents Meili, a novel system that realizes SmartNIC as a service to address these issues. Meili organizes heterogeneous SmartNIC resources as a pool and offers a unified one-NIC abstraction to application developers. This allows developers to focus solely on the application logic while dynamically optimizing their performance needs. Our evaluation on NVIDIA BlueField series and AMD Pensando SmartNICs demonstrates that Meili achieves scalable single-flow throughput with a maximum 8 μs latency overhead and enhances resource efficiency by 3.07$\times$ compared to standalone deployments and 1.44$\times$ compared to state-of-the-art microservice deployments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_11871 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Meili: Enabling SmartNIC as a Service in the Cloud Su, Qiang Wu, Shaofeng Niu, Zhixiong Shu, Ran Cheng, Peng Xiong, Yongqiang Liu, Zaoxing Xu, Hong Networking and Internet Architecture Distributed, Parallel, and Cluster Computing SmartNICs are touted as an attractive substrate for network application offloading, offering benefits in programmability, host resource saving, and energy efficiency. The current usage restricts offloading to local hosts and confines SmartNIC ownership to individual application teams, resulting in poor resource efficiency and scalability. This paper presents Meili, a novel system that realizes SmartNIC as a service to address these issues. Meili organizes heterogeneous SmartNIC resources as a pool and offers a unified one-NIC abstraction to application developers. This allows developers to focus solely on the application logic while dynamically optimizing their performance needs. Our evaluation on NVIDIA BlueField series and AMD Pensando SmartNICs demonstrates that Meili achieves scalable single-flow throughput with a maximum 8 μs latency overhead and enhances resource efficiency by 3.07$\times$ compared to standalone deployments and 1.44$\times$ compared to state-of-the-art microservice deployments. |
| title | Meili: Enabling SmartNIC as a Service in the Cloud |
| topic | Networking and Internet Architecture Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2312.11871 |