Quantum Deep Hedging

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cherrat, El Amine, Raj, Snehal, Kerenidis, Iordanis, Shekhar, Abhishek, Wood, Ben, Dee, Jon, Chakrabarti, Shouvanik, Chen, Richard, Herman, Dylan, Hu, Shaohan, Minssen, Pierre, Shaydulin, Ruslan, Sun, Yue, Yalovetzky, Romina, Pistoia, Marco
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914815713214464
author Cherrat, El Amine
Raj, Snehal
Kerenidis, Iordanis
Shekhar, Abhishek
Wood, Ben
Dee, Jon
Chakrabarti, Shouvanik
Chen, Richard
Herman, Dylan
Hu, Shaohan
Minssen, Pierre
Shaydulin, Ruslan
Sun, Yue
Yalovetzky, Romina
Pistoia, Marco
author_facet Cherrat, El Amine
Raj, Snehal
Kerenidis, Iordanis
Shekhar, Abhishek
Wood, Ben
Dee, Jon
Chakrabarti, Shouvanik
Chen, Richard
Herman, Dylan
Hu, Shaohan
Minssen, Pierre
Shaydulin, Ruslan
Sun, Yue
Yalovetzky, Romina
Pistoia, Marco
contents Quantum machine learning has the potential for a transformative impact across industry sectors and in particular in finance. In our work we look at the problem of hedging where deep reinforcement learning offers a powerful framework for real markets. We develop quantum reinforcement learning methods based on policy-search and distributional actor-critic algorithms that use quantum neural network architectures with orthogonal and compound layers for the policy and value functions. We prove that the quantum neural networks we use are trainable, and we perform extensive simulations that show that quantum models can reduce the number of trainable parameters while achieving comparable performance and that the distributional approach obtains better performance than other standard approaches, both classical and quantum. We successfully implement the proposed models on a trapped-ion quantum processor, utilizing circuits with up to $16$ qubits, and observe performance that agrees well with noiseless simulation. Our quantum techniques are general and can be applied to other reinforcement learning problems beyond hedging.
format Preprint
id arxiv_https___arxiv_org_abs_2303_16585
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Quantum Deep Hedging
Cherrat, El Amine
Raj, Snehal
Kerenidis, Iordanis
Shekhar, Abhishek
Wood, Ben
Dee, Jon
Chakrabarti, Shouvanik
Chen, Richard
Herman, Dylan
Hu, Shaohan
Minssen, Pierre
Shaydulin, Ruslan
Sun, Yue
Yalovetzky, Romina
Pistoia, Marco
Quantum Physics
Machine Learning
Computational Finance
Quantum machine learning has the potential for a transformative impact across industry sectors and in particular in finance. In our work we look at the problem of hedging where deep reinforcement learning offers a powerful framework for real markets. We develop quantum reinforcement learning methods based on policy-search and distributional actor-critic algorithms that use quantum neural network architectures with orthogonal and compound layers for the policy and value functions. We prove that the quantum neural networks we use are trainable, and we perform extensive simulations that show that quantum models can reduce the number of trainable parameters while achieving comparable performance and that the distributional approach obtains better performance than other standard approaches, both classical and quantum. We successfully implement the proposed models on a trapped-ion quantum processor, utilizing circuits with up to $16$ qubits, and observe performance that agrees well with noiseless simulation. Our quantum techniques are general and can be applied to other reinforcement learning problems beyond hedging.
title Quantum Deep Hedging
topic Quantum Physics
Machine Learning
Computational Finance
url https://arxiv.org/abs/2303.16585