Communication Offloading on SmartNIC DPUs: A Quantitative Approach

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wahlgren, Jacob, Hu, Andong, Pearce, Roger, Gokhale, Maya, Peng, Ivy
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914589674831872
author Wahlgren, Jacob
Hu, Andong
Pearce, Roger
Gokhale, Maya
Peng, Ivy
author_facet Wahlgren, Jacob
Hu, Andong
Pearce, Roger
Gokhale, Maya
Peng, Ivy
contents SmartNIC Data Processing Units (DPUs) offer a promising solution for saving high-end CPU resources by offloading tasks to programmable cores near the network interface. In this work, we explore the feasibility of SmartNIC DPUs in supporting an asynchronous communication model called "fire-and-forget", particularly its core message routing service. We design a communication offloading engine called Buddy that decouples communication tasks from the application process. Buddy runs flexibly on SmartNIC DPUs such as the Nvidia BlueField-3 DPU and generic x86 CPUs. Our evaluation results in five applications identify the memory-to-communication ratio as a key predictor of the offloading performance. Host-dominated workloads, such as Quicksilver and Sparse Matrix Transpose, achieved up to 1.55x speedup with communication offloaded to the DPU. We further identify a 625x increase in DRAM traffic due to the absence of Direct Cache Access support on the DPU, highlighting a critical need in future SmartNIC designs.
format Preprint
id arxiv_https___arxiv_org_abs_2605_04842
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Communication Offloading on SmartNIC DPUs: A Quantitative Approach
Wahlgren, Jacob
Hu, Andong
Pearce, Roger
Gokhale, Maya
Peng, Ivy
Distributed, Parallel, and Cluster Computing
SmartNIC Data Processing Units (DPUs) offer a promising solution for saving high-end CPU resources by offloading tasks to programmable cores near the network interface. In this work, we explore the feasibility of SmartNIC DPUs in supporting an asynchronous communication model called "fire-and-forget", particularly its core message routing service. We design a communication offloading engine called Buddy that decouples communication tasks from the application process. Buddy runs flexibly on SmartNIC DPUs such as the Nvidia BlueField-3 DPU and generic x86 CPUs. Our evaluation results in five applications identify the memory-to-communication ratio as a key predictor of the offloading performance. Host-dominated workloads, such as Quicksilver and Sparse Matrix Transpose, achieved up to 1.55x speedup with communication offloaded to the DPU. We further identify a 625x increase in DRAM traffic due to the absence of Direct Cache Access support on the DPU, highlighting a critical need in future SmartNIC designs.
title Communication Offloading on SmartNIC DPUs: A Quantitative Approach
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2605.04842