Quantum feedback control with a transformer neural network architecture

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Vaidhyanathan, Pranav, Marquardt, Florian, Mitchison, Mark T., Ares, Natalia
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912926751784960
author Vaidhyanathan, Pranav
Marquardt, Florian
Mitchison, Mark T.
Ares, Natalia
author_facet Vaidhyanathan, Pranav
Marquardt, Florian
Mitchison, Mark T.
Ares, Natalia
contents Attention-based neural networks such as transformers have revolutionized various fields such as natural language processing, genomics, and vision. Here, we demonstrate the use of transformers for quantum feedback control through both a supervised and reinforcement learning approach. In particular, due to the transformer's ability to capture long-range temporal correlations and training efficiency, we show that it can surpass some of the limitations of previous control approaches, e.g.~those based on recurrent neural networks trained using a similar approach or policy based reinforcement learning. We numerically show, for the example of state stabilization of a two-level system, that our bespoke transformer architecture can achieve near unit fidelity to a target state in a short time even in the presence of inefficient measurement and Hamiltonian perturbations that were not included in the training set as well as the control of non-Markovian systems. We also demonstrate that our transformer can perform energy minimization of non-integrable many-body quantum systems when trained for reinforcement learning tasks. Our approach can be used for quantum error correction, fast control of quantum states in the presence of colored noise, as well as real-time tuning, and characterization of quantum devices.
format Preprint
id arxiv_https___arxiv_org_abs_2411_19253
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Quantum feedback control with a transformer neural network architecture
Vaidhyanathan, Pranav
Marquardt, Florian
Mitchison, Mark T.
Ares, Natalia
Quantum Physics
Mesoscale and Nanoscale Physics
Machine Learning
Attention-based neural networks such as transformers have revolutionized various fields such as natural language processing, genomics, and vision. Here, we demonstrate the use of transformers for quantum feedback control through both a supervised and reinforcement learning approach. In particular, due to the transformer's ability to capture long-range temporal correlations and training efficiency, we show that it can surpass some of the limitations of previous control approaches, e.g.~those based on recurrent neural networks trained using a similar approach or policy based reinforcement learning. We numerically show, for the example of state stabilization of a two-level system, that our bespoke transformer architecture can achieve near unit fidelity to a target state in a short time even in the presence of inefficient measurement and Hamiltonian perturbations that were not included in the training set as well as the control of non-Markovian systems. We also demonstrate that our transformer can perform energy minimization of non-integrable many-body quantum systems when trained for reinforcement learning tasks. Our approach can be used for quantum error correction, fast control of quantum states in the presence of colored noise, as well as real-time tuning, and characterization of quantum devices.
title Quantum feedback control with a transformer neural network architecture
topic Quantum Physics
Mesoscale and Nanoscale Physics
Machine Learning
url https://arxiv.org/abs/2411.19253