Saved in:
Bibliographic Details
Main Authors: Aboumrad, Willie, Girotto, Claudio, Goings, Joshua, Zhao, Luning, Lopez-Ruiz, Miguel Angel, Zhu, Daiwei, Kaushik, Ananth, Ray, Sayonee, Sekwao, Samwel, Iaconis, Jason, Arrasmith, Andrew, Maksymov, Andrii, de Sereville, Yvette, Tripier, Felix, McKon, Far, Collins, Coleman, Epifanovsky, Evgeny, Yamada, Masako, Roetteler, Martin
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.11781
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918443580653568
author Aboumrad, Willie
Girotto, Claudio
Goings, Joshua
Zhao, Luning
Lopez-Ruiz, Miguel Angel
Zhu, Daiwei
Kaushik, Ananth
Ray, Sayonee
Sekwao, Samwel
Iaconis, Jason
Arrasmith, Andrew
Maksymov, Andrii
de Sereville, Yvette
Tripier, Felix
McKon, Far
Collins, Coleman
Epifanovsky, Evgeny
Yamada, Masako
Roetteler, Martin
author_facet Aboumrad, Willie
Girotto, Claudio
Goings, Joshua
Zhao, Luning
Lopez-Ruiz, Miguel Angel
Zhu, Daiwei
Kaushik, Ananth
Ray, Sayonee
Sekwao, Samwel
Iaconis, Jason
Arrasmith, Andrew
Maksymov, Andrii
de Sereville, Yvette
Tripier, Felix
McKon, Far
Collins, Coleman
Epifanovsky, Evgeny
Yamada, Masako
Roetteler, Martin
contents As quantum computing systems continue to mature, there is an increasing need for benchmarking methodologies that capture performance in terms of meaningful, application-level metrics. In this work, we present a scalable framework for application-level quantum benchmarking that is designed to support internal system evaluation and cross-platform comparison across technology providers. Our framework is guided by a set of core principles, including measurability, simplicity, scalability, and extensibility. We present 13 benchmark families that reflect realistic workloads across multiple domains. This enables the systematic evaluation of the quality of solutions, the total execution time, total used energy, as well as Time-to-Solution. The benchmarks are designed to be reproducible, interpretable across stakeholder groups, and adaptable to evolving system capabilities. The framework aims to bridge the gap between low-level performance metrics and real-world value, providing a unified approach to assessing quantum systems. The resulting benchmarks support development and validation and contribute to the foundation of industry-wide benchmarking standards.
format Preprint
id arxiv_https___arxiv_org_abs_2604_11781
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Measuring what matters: A scalable framework for application-level quantum benchmarking
Aboumrad, Willie
Girotto, Claudio
Goings, Joshua
Zhao, Luning
Lopez-Ruiz, Miguel Angel
Zhu, Daiwei
Kaushik, Ananth
Ray, Sayonee
Sekwao, Samwel
Iaconis, Jason
Arrasmith, Andrew
Maksymov, Andrii
de Sereville, Yvette
Tripier, Felix
McKon, Far
Collins, Coleman
Epifanovsky, Evgeny
Yamada, Masako
Roetteler, Martin
Quantum Physics
As quantum computing systems continue to mature, there is an increasing need for benchmarking methodologies that capture performance in terms of meaningful, application-level metrics. In this work, we present a scalable framework for application-level quantum benchmarking that is designed to support internal system evaluation and cross-platform comparison across technology providers. Our framework is guided by a set of core principles, including measurability, simplicity, scalability, and extensibility. We present 13 benchmark families that reflect realistic workloads across multiple domains. This enables the systematic evaluation of the quality of solutions, the total execution time, total used energy, as well as Time-to-Solution. The benchmarks are designed to be reproducible, interpretable across stakeholder groups, and adaptable to evolving system capabilities. The framework aims to bridge the gap between low-level performance metrics and real-world value, providing a unified approach to assessing quantum systems. The resulting benchmarks support development and validation and contribute to the foundation of industry-wide benchmarking standards.
title Measuring what matters: A scalable framework for application-level quantum benchmarking
topic Quantum Physics
url https://arxiv.org/abs/2604.11781