NotNets: Accelerating Microservices by Bypassing the Network

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Alvaro, Peter, Adiletta, Matthew, Cockroft, Adrian, Hady, Frank, Illikkal, Ramesh, Ramos, Esteban, Tsai, James, Soulé, Robert
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929308386197504
author Alvaro, Peter
Adiletta, Matthew
Cockroft, Adrian
Hady, Frank
Illikkal, Ramesh
Ramos, Esteban
Tsai, James
Soulé, Robert
author_facet Alvaro, Peter
Adiletta, Matthew
Cockroft, Adrian
Hady, Frank
Illikkal, Ramesh
Ramos, Esteban
Tsai, James
Soulé, Robert
contents Remote procedure calls are the workhorse of distributed systems. However, as software engineering trends, such as micro-services and serverless computing, push applications towards ever finer-grained decompositions, the overhead of RPC-based communication is becoming too great to bear. In this paper, we argue that point solutions that attempt to optimize one aspect of RPC logic are unlikely to mitigate these ballooning communication costs. Rather, we need a dramatic reappraisal of how we provide communication. Towards this end, we propose to emulate message-passing RPCs by sharing message payloads and metadata on CXL 3.0-backed far memory. We provide initial evidence of feasibility and analyze the expected benefits.
format Preprint
id arxiv_https___arxiv_org_abs_2404_06581
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle NotNets: Accelerating Microservices by Bypassing the Network
Alvaro, Peter
Adiletta, Matthew
Cockroft, Adrian
Hady, Frank
Illikkal, Ramesh
Ramos, Esteban
Tsai, James
Soulé, Robert
Distributed, Parallel, and Cluster Computing
Remote procedure calls are the workhorse of distributed systems. However, as software engineering trends, such as micro-services and serverless computing, push applications towards ever finer-grained decompositions, the overhead of RPC-based communication is becoming too great to bear. In this paper, we argue that point solutions that attempt to optimize one aspect of RPC logic are unlikely to mitigate these ballooning communication costs. Rather, we need a dramatic reappraisal of how we provide communication. Towards this end, we propose to emulate message-passing RPCs by sharing message payloads and metadata on CXL 3.0-backed far memory. We provide initial evidence of feasibility and analyze the expected benefits.
title NotNets: Accelerating Microservices by Bypassing the Network
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2404.06581