First Experience with Real-Time Control Using Simulated VQC-Based Quantum Policies

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sun, Yize, Hagog, Mohamad, Weber, Marc, Hein, Daniel, Udluft, Steffen, Tresp, Volker, Ma, Yunpu
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913984134774784
author Sun, Yize
Hagog, Mohamad
Weber, Marc
Hein, Daniel
Udluft, Steffen
Tresp, Volker
Ma, Yunpu
author_facet Sun, Yize
Hagog, Mohamad
Weber, Marc
Hein, Daniel
Udluft, Steffen
Tresp, Volker
Ma, Yunpu
contents This paper investigates the integration of quantum computing into offline reinforcement learning and the deployment of the resulting quantum policy in a real-time control hardware realization of the cart-pole system. Variational Quantum Circuits (VQCs) are used to represent the policy. Classical model-based offline policy search was applied, in which a pure VQC with trainable input-output weights is used as a policy network instead of a classical multilayer perceptron. The goal is to evaluate the potential of deploying quantum architectures in real-world industrial control problems. The experimental results show that the investigated model-based offline policy search is able to generate quantum policies that can balance the hardware cart-pole. A latency analysis reveals that while local simulated execution meets real-time requirements, cloud-based quantum processing remains too slow for closed-loop control.
format Preprint
id arxiv_https___arxiv_org_abs_2508_01690
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle First Experience with Real-Time Control Using Simulated VQC-Based Quantum Policies
Sun, Yize
Hagog, Mohamad
Weber, Marc
Hein, Daniel
Udluft, Steffen
Tresp, Volker
Ma, Yunpu
Quantum Physics
This paper investigates the integration of quantum computing into offline reinforcement learning and the deployment of the resulting quantum policy in a real-time control hardware realization of the cart-pole system. Variational Quantum Circuits (VQCs) are used to represent the policy. Classical model-based offline policy search was applied, in which a pure VQC with trainable input-output weights is used as a policy network instead of a classical multilayer perceptron. The goal is to evaluate the potential of deploying quantum architectures in real-world industrial control problems. The experimental results show that the investigated model-based offline policy search is able to generate quantum policies that can balance the hardware cart-pole. A latency analysis reveals that while local simulated execution meets real-time requirements, cloud-based quantum processing remains too slow for closed-loop control.
title First Experience with Real-Time Control Using Simulated VQC-Based Quantum Policies
topic Quantum Physics
url https://arxiv.org/abs/2508.01690