On‐demand JSON: A better way to parse documents?

Fuente: Wiley Open Access
Saved in:
Bibliographic Details
Main Authors: John Keiser, Daniel Lemire
Format: Artículo Open Access
Published: Wiley 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1867008137772400640
author John Keiser
Daniel Lemire
author_facet John Keiser
Daniel Lemire
John Keiser
Daniel Lemire
collection Wiley Open Access
contents On‐demand JSON: A better way to parse documents? John Keiser Daniel Lemire Software: Practice and Experience SummaryJSON is a popular standard for data interchange on the Internet. Ingesting JSON documents can be a performance bottleneck. A popular parsing strategy consists in converting the input text into a tree‐based data structure—sometimes called a Document Object Model or DOM. We designed and implemented a novel JSON parsing interface—called On‐Demand—that appears to the programmer like a conventional DOM‐based approach. However, the underlying implementation is a pointer iterating through the content, only materializing the results (objects, arrays, strings, numbers) lazily. On recent commodity processors, an implementation of our approach provides superior performance in multiple benchmarks. To ensure reproducibility, our work is freely available as open source software. Several systems use On Demand: for example, Apache Doris, the Node.js JavaScript runtime, Milvus, and Velox. 10.1002/spe.3313 http://creativecommons.org/licenses/by/4.0/
doi_str_mv 10.1002/spe.3313
format Artículo Open Access
id wiley_oa_10_1002_spe_3313
institution Wiley Open Access
license_str_mv http://creativecommons.org/licenses/by/4.0/
publishDate 2024
publisher Wiley
record_format wiley_oa
spellingShingle On‐demand JSON: A better way to parse documents?
John Keiser
Daniel Lemire
Software: Practice and Experience
On‐demand JSON: A better way to parse documents? John Keiser Daniel Lemire Software: Practice and Experience SummaryJSON is a popular standard for data interchange on the Internet. Ingesting JSON documents can be a performance bottleneck. A popular parsing strategy consists in converting the input text into a tree‐based data structure—sometimes called a Document Object Model or DOM. We designed and implemented a novel JSON parsing interface—called On‐Demand—that appears to the programmer like a conventional DOM‐based approach. However, the underlying implementation is a pointer iterating through the content, only materializing the results (objects, arrays, strings, numbers) lazily. On recent commodity processors, an implementation of our approach provides superior performance in multiple benchmarks. To ensure reproducibility, our work is freely available as open source software. Several systems use On Demand: for example, Apache Doris, the Node.js JavaScript runtime, Milvus, and Velox. 10.1002/spe.3313 http://creativecommons.org/licenses/by/4.0/
title On‐demand JSON: A better way to parse documents?
topic Software: Practice and Experience
url https://onlinelibrary.wiley.com/doi/10.1002/spe.3313