Benchmarking the Operation of Quantum Heuristics and Ising Machines: Scoring Parameter Setting Strategies on Optimization Applications

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Neira, David E. Bernal, Brown, Robin, Sathe, Pratik, Wudarski, Filip, Pavone, Marco, Rieffel, Eleanor G., Venturelli, Davide
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909108705165312
author Neira, David E. Bernal
Brown, Robin
Sathe, Pratik
Wudarski, Filip
Pavone, Marco
Rieffel, Eleanor G.
Venturelli, Davide
author_facet Neira, David E. Bernal
Brown, Robin
Sathe, Pratik
Wudarski, Filip
Pavone, Marco
Rieffel, Eleanor G.
Venturelli, Davide
contents We discuss guidelines for evaluating the performance of parameterized stochastic solvers for optimization problems, with particular attention to systems that employ novel hardware, such as digital quantum processors running variational algorithms, analog processors performing quantum annealing, or coherent Ising Machines. We illustrate through an example a benchmarking procedure grounded in the statistical analysis of the expectation of a given performance metric measured in a test environment. In particular, we discuss the necessity and cost of setting parameters that affect the algorithm's performance. The optimal value of these parameters could vary significantly between instances of the same target problem. We present an open-source software package that facilitates the design, evaluation, and visualization of practical parameter tuning strategies for complex use of the heterogeneous components of the solver. We examine in detail an example using parallel tempering and a simulator of a photonic Coherent Ising Machine computing and display the scoring of an illustrative baseline family of parameter-setting strategies that feature an exploration-exploitation trade-off.
format Preprint
id arxiv_https___arxiv_org_abs_2402_10255
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Benchmarking the Operation of Quantum Heuristics and Ising Machines: Scoring Parameter Setting Strategies on Optimization Applications
Neira, David E. Bernal
Brown, Robin
Sathe, Pratik
Wudarski, Filip
Pavone, Marco
Rieffel, Eleanor G.
Venturelli, Davide
Quantum Physics
Emerging Technologies
Computation
Methodology
We discuss guidelines for evaluating the performance of parameterized stochastic solvers for optimization problems, with particular attention to systems that employ novel hardware, such as digital quantum processors running variational algorithms, analog processors performing quantum annealing, or coherent Ising Machines. We illustrate through an example a benchmarking procedure grounded in the statistical analysis of the expectation of a given performance metric measured in a test environment. In particular, we discuss the necessity and cost of setting parameters that affect the algorithm's performance. The optimal value of these parameters could vary significantly between instances of the same target problem. We present an open-source software package that facilitates the design, evaluation, and visualization of practical parameter tuning strategies for complex use of the heterogeneous components of the solver. We examine in detail an example using parallel tempering and a simulator of a photonic Coherent Ising Machine computing and display the scoring of an illustrative baseline family of parameter-setting strategies that feature an exploration-exploitation trade-off.
title Benchmarking the Operation of Quantum Heuristics and Ising Machines: Scoring Parameter Setting Strategies on Optimization Applications
topic Quantum Physics
Emerging Technologies
Computation
Methodology
url https://arxiv.org/abs/2402.10255