Shelby: Decentralized Storage Designed to Serve

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Goren, Guy, Hariri, Andrew, Hartley, Timothy D. R., Kappiyoor, Ravi, Spiegelman, Alexander, Zmick, David
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911020326322176
author Goren, Guy
Hariri, Andrew
Hartley, Timothy D. R.
Kappiyoor, Ravi
Spiegelman, Alexander
Zmick, David
author_facet Goren, Guy
Hariri, Andrew
Hartley, Timothy D. R.
Kappiyoor, Ravi
Spiegelman, Alexander
Zmick, David
contents Existing decentralized storage protocols fall short of the service required by real-world applications. Their throughput, latency, cost-effectiveness, and availability are insufficient for demanding workloads such as video streaming, large-scale data analytics, or AI training. As a result, Web3 data-intensive applications are predominantly dependent on centralized infrastructure. Shelby is a high-performance decentralized storage protocol designed to meet demanding needs. It achieves fast, reliable access to large volumes of data while preserving decentralization guarantees. The architecture reflects lessons from Web2 systems: it separates control and data planes, uses erasure coding with low replication overhead and minimal repair bandwidth, and operates over a dedicated backbone connecting RPC and storage nodes. Reads are paid, which incentivizes good performance. Shelby also introduces a novel auditing protocol that provides strong cryptoeconomic guarantees without compromising performance, a common limitation of other decentralized solutions. The result is a decentralized system that brings Web2-grade performance to production-scale, read-intensive Web3 applications.
format Preprint
id arxiv_https___arxiv_org_abs_2506_19233
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Shelby: Decentralized Storage Designed to Serve
Goren, Guy
Hariri, Andrew
Hartley, Timothy D. R.
Kappiyoor, Ravi
Spiegelman, Alexander
Zmick, David
Distributed, Parallel, and Cluster Computing
Existing decentralized storage protocols fall short of the service required by real-world applications. Their throughput, latency, cost-effectiveness, and availability are insufficient for demanding workloads such as video streaming, large-scale data analytics, or AI training. As a result, Web3 data-intensive applications are predominantly dependent on centralized infrastructure. Shelby is a high-performance decentralized storage protocol designed to meet demanding needs. It achieves fast, reliable access to large volumes of data while preserving decentralization guarantees. The architecture reflects lessons from Web2 systems: it separates control and data planes, uses erasure coding with low replication overhead and minimal repair bandwidth, and operates over a dedicated backbone connecting RPC and storage nodes. Reads are paid, which incentivizes good performance. Shelby also introduces a novel auditing protocol that provides strong cryptoeconomic guarantees without compromising performance, a common limitation of other decentralized solutions. The result is a decentralized system that brings Web2-grade performance to production-scale, read-intensive Web3 applications.
title Shelby: Decentralized Storage Designed to Serve
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2506.19233