Towards Disaggregation-Native Data Streaming between Devices

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Asmussen, Nils, Roitzsch, Michael
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916286164893696
author Asmussen, Nils
Roitzsch, Michael
author_facet Asmussen, Nils
Roitzsch, Michael
contents Disaggregation is an ongoing trend to increase flexibility in datacenters. With interconnect technologies like CXL, pools of CPUs, accelerators, and memory can be connected via a datacenter fabric. Applications can then pick from those pools the resources necessary for their specific workload. However, this vision becomes less clear when we consider data movement. Workloads often require data to be streamed through chains of multiple devices, but typically, these data streams physically do not directly flow device-to-device, but are staged in memory by a CPU hosting device protocol logic. We show that augmenting devices with a disaggregation-native and device-independent data streaming facility can improve processing latencies by enabling data flows directly between arbitrary devices.
format Preprint
id arxiv_https___arxiv_org_abs_2406_09421
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Disaggregation-Native Data Streaming between Devices
Asmussen, Nils
Roitzsch, Michael
Distributed, Parallel, and Cluster Computing
Disaggregation is an ongoing trend to increase flexibility in datacenters. With interconnect technologies like CXL, pools of CPUs, accelerators, and memory can be connected via a datacenter fabric. Applications can then pick from those pools the resources necessary for their specific workload. However, this vision becomes less clear when we consider data movement. Workloads often require data to be streamed through chains of multiple devices, but typically, these data streams physically do not directly flow device-to-device, but are staged in memory by a CPU hosting device protocol logic. We show that augmenting devices with a disaggregation-native and device-independent data streaming facility can improve processing latencies by enabling data flows directly between arbitrary devices.
title Towards Disaggregation-Native Data Streaming between Devices
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2406.09421