Artificially intelligent Maxwell's demon for optimal control of open quantum systems

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Erdman, Paolo Andrea, Czupryniak, Robert, Bhandari, Bibek, Jordan, Andrew N., Noé, Frank, Eisert, Jens, Guarnieri, Giacomo
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912315057635328
author Erdman, Paolo Andrea
Czupryniak, Robert
Bhandari, Bibek
Jordan, Andrew N.
Noé, Frank
Eisert, Jens
Guarnieri, Giacomo
author_facet Erdman, Paolo Andrea
Czupryniak, Robert
Bhandari, Bibek
Jordan, Andrew N.
Noé, Frank
Eisert, Jens
Guarnieri, Giacomo
contents Feedback control of open quantum systems is of fundamental importance for practical applications in various contexts, ranging from quantum computation to quantum error correction and quantum metrology. Its use in the context of thermodynamics further enables the study of the interplay between information and energy. However, deriving optimal feedback control strategies is highly challenging, as it involves the optimal control of open quantum systems, the stochastic nature of quantum measurement, and the inclusion of policies that maximize a long-term time- and trajectory-averaged goal. In this work, we employ a reinforcement learning approach to automate and capture the role of a quantum Maxwell's demon: the agent takes the literal role of discovering optimal feedback control strategies in qubit-based systems that maximize a trade-off between measurement-powered cooling and measurement efficiency. Considering weak or projective quantum measurements, we explore different regimes based on the ordering between the thermalization, the measurement, and the unitary feedback timescales, finding different and highly non-intuitive, yet interpretable, strategies. In the thermalization-dominated regime, we find strategies with elaborate finite-time thermalization protocols conditioned on measurement outcomes. In the measurement-dominated regime, we find that optimal strategies involve adaptively measuring different qubit observables reflecting the acquired information, and repeating multiple weak measurements until the quantum state is "sufficiently pure", leading to random walks in state space. Finally, we study the case when all timescales are comparable, finding new feedback control strategies that considerably outperform more intuitive ones. We discuss a two-qubit example where we explore the role of entanglement and conclude discussing the scaling of our results to quantum many-body systems.
format Preprint
id arxiv_https___arxiv_org_abs_2408_15328
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Artificially intelligent Maxwell's demon for optimal control of open quantum systems
Erdman, Paolo Andrea
Czupryniak, Robert
Bhandari, Bibek
Jordan, Andrew N.
Noé, Frank
Eisert, Jens
Guarnieri, Giacomo
Quantum Physics
Mesoscale and Nanoscale Physics
Machine Learning
Feedback control of open quantum systems is of fundamental importance for practical applications in various contexts, ranging from quantum computation to quantum error correction and quantum metrology. Its use in the context of thermodynamics further enables the study of the interplay between information and energy. However, deriving optimal feedback control strategies is highly challenging, as it involves the optimal control of open quantum systems, the stochastic nature of quantum measurement, and the inclusion of policies that maximize a long-term time- and trajectory-averaged goal. In this work, we employ a reinforcement learning approach to automate and capture the role of a quantum Maxwell's demon: the agent takes the literal role of discovering optimal feedback control strategies in qubit-based systems that maximize a trade-off between measurement-powered cooling and measurement efficiency. Considering weak or projective quantum measurements, we explore different regimes based on the ordering between the thermalization, the measurement, and the unitary feedback timescales, finding different and highly non-intuitive, yet interpretable, strategies. In the thermalization-dominated regime, we find strategies with elaborate finite-time thermalization protocols conditioned on measurement outcomes. In the measurement-dominated regime, we find that optimal strategies involve adaptively measuring different qubit observables reflecting the acquired information, and repeating multiple weak measurements until the quantum state is "sufficiently pure", leading to random walks in state space. Finally, we study the case when all timescales are comparable, finding new feedback control strategies that considerably outperform more intuitive ones. We discuss a two-qubit example where we explore the role of entanglement and conclude discussing the scaling of our results to quantum many-body systems.
title Artificially intelligent Maxwell's demon for optimal control of open quantum systems
topic Quantum Physics
Mesoscale and Nanoscale Physics
Machine Learning
url https://arxiv.org/abs/2408.15328