Unlocking True Elasticity for the Cloud-Native Era with Dandelion

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kuchler, Tom, Li, Pinghe, Zhang, Yazhuo, Cvetković, Lazar, Goranov, Boris, Stocker, Tobias, Thomm, Leon, Kalbermatter, Simone, Notter, Tim, Lattuada, Andrea, Klimovic, Ana
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914115750985728
author Kuchler, Tom
Li, Pinghe
Zhang, Yazhuo
Cvetković, Lazar
Goranov, Boris
Stocker, Tobias
Thomm, Leon
Kalbermatter, Simone
Notter, Tim
Lattuada, Andrea
Klimovic, Ana
author_facet Kuchler, Tom
Li, Pinghe
Zhang, Yazhuo
Cvetković, Lazar
Goranov, Boris
Stocker, Tobias
Thomm, Leon
Kalbermatter, Simone
Notter, Tim
Lattuada, Andrea
Klimovic, Ana
contents Elasticity is fundamental to cloud computing, as it enables quickly allocating resources to match the demand of each workload as it arrives, rather than pre-provisioning resources to meet performance objectives. However, even serverless platforms -- which boot sandboxes in 10s to 100s of milliseconds -- are not sufficiently elastic to avoid over-provisioning expensive resources. Today's FaaS platforms rely on pre-provisioning many idle sandboxes in memory to reduce the occurrence of slow, cold starts. A key obstacle for high elasticity is booting a guest OS and configuring features like networking in sandboxes, which are required to expose an isolated POSIX-like interface to user functions. Our key insight is that redesigning the interface for applications in the cloud-native era enables co-designing a much more efficient and elastic execution system. Now is a good time to rethink cloud abstractions as developers are building applications to be cloud-native. Cloud-native applications typically consist of user-provided compute logic interacting with cloud services (for storage, AI inference, query processing, etc) exposed over REST APIs. Hence, we propose Dandelion, an elastic cloud platform with a declarative programming model that expresses applications as DAGs of pure compute functions and higher-level communication functions. Dandelion can securely execute untrusted user compute functions in lightweight sandboxes that cold start in hundreds of microseconds, since pure functions do not rely on extra software environments such as a guest OS. Dandelion makes it practical to boot a sandbox on-demand for each request, decreasing performance variability by two to three orders of magnitude compared to Firecracker and reducing committed memory by 96% on average when running the Azure Functions trace.
format Preprint
id arxiv_https___arxiv_org_abs_2505_01603
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Unlocking True Elasticity for the Cloud-Native Era with Dandelion
Kuchler, Tom
Li, Pinghe
Zhang, Yazhuo
Cvetković, Lazar
Goranov, Boris
Stocker, Tobias
Thomm, Leon
Kalbermatter, Simone
Notter, Tim
Lattuada, Andrea
Klimovic, Ana
Distributed, Parallel, and Cluster Computing
Operating Systems
Elasticity is fundamental to cloud computing, as it enables quickly allocating resources to match the demand of each workload as it arrives, rather than pre-provisioning resources to meet performance objectives. However, even serverless platforms -- which boot sandboxes in 10s to 100s of milliseconds -- are not sufficiently elastic to avoid over-provisioning expensive resources. Today's FaaS platforms rely on pre-provisioning many idle sandboxes in memory to reduce the occurrence of slow, cold starts. A key obstacle for high elasticity is booting a guest OS and configuring features like networking in sandboxes, which are required to expose an isolated POSIX-like interface to user functions. Our key insight is that redesigning the interface for applications in the cloud-native era enables co-designing a much more efficient and elastic execution system. Now is a good time to rethink cloud abstractions as developers are building applications to be cloud-native. Cloud-native applications typically consist of user-provided compute logic interacting with cloud services (for storage, AI inference, query processing, etc) exposed over REST APIs. Hence, we propose Dandelion, an elastic cloud platform with a declarative programming model that expresses applications as DAGs of pure compute functions and higher-level communication functions. Dandelion can securely execute untrusted user compute functions in lightweight sandboxes that cold start in hundreds of microseconds, since pure functions do not rely on extra software environments such as a guest OS. Dandelion makes it practical to boot a sandbox on-demand for each request, decreasing performance variability by two to three orders of magnitude compared to Firecracker and reducing committed memory by 96% on average when running the Azure Functions trace.
title Unlocking True Elasticity for the Cloud-Native Era with Dandelion
topic Distributed, Parallel, and Cluster Computing
Operating Systems
url https://arxiv.org/abs/2505.01603