Saved in:
Bibliographic Details
Main Authors: Yau, Guo Xian, Burushkina, Alexandra, da Silva, Francisco Ferreira, Maji, Subhransu, Thomas, Philip S., Vardoyan, Gayane
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.10634
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917367336927232
author Yau, Guo Xian
Burushkina, Alexandra
da Silva, Francisco Ferreira
Maji, Subhransu
Thomas, Philip S.
Vardoyan, Gayane
author_facet Yau, Guo Xian
Burushkina, Alexandra
da Silva, Francisco Ferreira
Maji, Subhransu
Thomas, Philip S.
Vardoyan, Gayane
contents Optimized control of quantum networks is essential for enabling distributed quantum applications with strict performance requirements. In near-term architectures with constrained hardware, effective control may determine the feasibility of deploying such applications. Because quantum network dynamics are suitable for being modeled as a Markov decision process, dynamic programming and reinforcement learning (RL) offer promising tools for optimizing control strategies. However, key quantum network performance measures -- such as secret key rate in quantum key distribution -- often involve a non-linear relationship between interdependent variables that describe quantum state quality and generation rate. Such objectives are not easily captured by standard RL approaches based on additive rewards. We propose a novel gradient-based RL framework that directly optimizes non-linear, differentiable objective functions, while accounting for uncertainties introduced by classical communication delays. We evaluate this framework in the context of entanglement distillation between two quantum network nodes equipped with multiplexing capability, and demonstrate up to 20-23% improvement over heuristic baselines in certain parameter regimes. Our work comprises the first step towards non-linear objective function optimization in quantum networks with RL, opening a path towards more advanced use cases.
format Preprint
id arxiv_https___arxiv_org_abs_2509_10634
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Reinforcement Learning for Quantum Network Control with Application-Driven Objectives
Yau, Guo Xian
Burushkina, Alexandra
da Silva, Francisco Ferreira
Maji, Subhransu
Thomas, Philip S.
Vardoyan, Gayane
Quantum Physics
Optimized control of quantum networks is essential for enabling distributed quantum applications with strict performance requirements. In near-term architectures with constrained hardware, effective control may determine the feasibility of deploying such applications. Because quantum network dynamics are suitable for being modeled as a Markov decision process, dynamic programming and reinforcement learning (RL) offer promising tools for optimizing control strategies. However, key quantum network performance measures -- such as secret key rate in quantum key distribution -- often involve a non-linear relationship between interdependent variables that describe quantum state quality and generation rate. Such objectives are not easily captured by standard RL approaches based on additive rewards. We propose a novel gradient-based RL framework that directly optimizes non-linear, differentiable objective functions, while accounting for uncertainties introduced by classical communication delays. We evaluate this framework in the context of entanglement distillation between two quantum network nodes equipped with multiplexing capability, and demonstrate up to 20-23% improvement over heuristic baselines in certain parameter regimes. Our work comprises the first step towards non-linear objective function optimization in quantum networks with RL, opening a path towards more advanced use cases.
title Reinforcement Learning for Quantum Network Control with Application-Driven Objectives
topic Quantum Physics
url https://arxiv.org/abs/2509.10634