BCQQ: Batch-Constraint Quantum Q-Learning with Cyclic Data Re-uploading
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913575782580224 |
|---|---|
| author | Periyasamy, Maniraman Hölle, Marc Wiedmann, Marco Scherer, Daniel D. Plinge, Axel Mutschler, Christopher |
| author_facet | Periyasamy, Maniraman Hölle, Marc Wiedmann, Marco Scherer, Daniel D. Plinge, Axel Mutschler, Christopher |
| contents | Deep reinforcement learning (DRL) often requires a large number of data and environment interactions, making the training process time-consuming. This challenge is further exacerbated in the case of batch RL, where the agent is trained solely on a pre-collected dataset without environment interactions. Recent advancements in quantum computing suggest that quantum models might require less data for training compared to classical methods. In this paper, we investigate this potential advantage by proposing a batch RL algorithm that utilizes VQC as function approximators within the discrete batch-constraint deep Q-learning (BCQ) algorithm. Additionally, we introduce a novel data re-uploading scheme by cyclically shifting the order of input variables in the data encoding layers. We evaluate the efficiency of our algorithm on the OpenAI CartPole environment and compare its performance to the classical neural network-based discrete BCQ. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_00905 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | BCQQ: Batch-Constraint Quantum Q-Learning with Cyclic Data Re-uploading Periyasamy, Maniraman Hölle, Marc Wiedmann, Marco Scherer, Daniel D. Plinge, Axel Mutschler, Christopher Quantum Physics Machine Learning Deep reinforcement learning (DRL) often requires a large number of data and environment interactions, making the training process time-consuming. This challenge is further exacerbated in the case of batch RL, where the agent is trained solely on a pre-collected dataset without environment interactions. Recent advancements in quantum computing suggest that quantum models might require less data for training compared to classical methods. In this paper, we investigate this potential advantage by proposing a batch RL algorithm that utilizes VQC as function approximators within the discrete batch-constraint deep Q-learning (BCQ) algorithm. Additionally, we introduce a novel data re-uploading scheme by cyclically shifting the order of input variables in the data encoding layers. We evaluate the efficiency of our algorithm on the OpenAI CartPole environment and compare its performance to the classical neural network-based discrete BCQ. |
| title | BCQQ: Batch-Constraint Quantum Q-Learning with Cyclic Data Re-uploading |
| topic | Quantum Physics Machine Learning |
| url | https://arxiv.org/abs/2305.00905 |