Robustness and Generalization in Quantum Reinforcement Learning via Lipschitz Regularization
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929563340111872 |
|---|---|
| author | Meyer, Nico Berberich, Julian Mutschler, Christopher Scherer, Daniel D. |
| author_facet | Meyer, Nico Berberich, Julian Mutschler, Christopher Scherer, Daniel D. |
| contents | Quantum machine learning leverages quantum computing to enhance accuracy and reduce model complexity compared to classical approaches, promising significant advancements in various fields. Within this domain, quantum reinforcement learning has garnered attention, often realized using variational quantum circuits to approximate the policy function. This paper addresses the robustness and generalization of quantum reinforcement learning by combining principles from quantum computing and control theory. Leveraging recent results on robust quantum machine learning, we utilize Lipschitz bounds to propose a regularized version of a quantum policy gradient approach, named the RegQPG algorithm. We show that training with RegQPG improves the robustness and generalization of the resulting policies. Furthermore, we introduce an algorithmic variant that incorporates curriculum learning, which minimizes failures during training. Our findings are validated through numerical experiments, demonstrating the practical benefits of our approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_21117 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Robustness and Generalization in Quantum Reinforcement Learning via Lipschitz Regularization Meyer, Nico Berberich, Julian Mutschler, Christopher Scherer, Daniel D. Quantum Physics Machine Learning Quantum machine learning leverages quantum computing to enhance accuracy and reduce model complexity compared to classical approaches, promising significant advancements in various fields. Within this domain, quantum reinforcement learning has garnered attention, often realized using variational quantum circuits to approximate the policy function. This paper addresses the robustness and generalization of quantum reinforcement learning by combining principles from quantum computing and control theory. Leveraging recent results on robust quantum machine learning, we utilize Lipschitz bounds to propose a regularized version of a quantum policy gradient approach, named the RegQPG algorithm. We show that training with RegQPG improves the robustness and generalization of the resulting policies. Furthermore, we introduce an algorithmic variant that incorporates curriculum learning, which minimizes failures during training. Our findings are validated through numerical experiments, demonstrating the practical benefits of our approach. |
| title | Robustness and Generalization in Quantum Reinforcement Learning via Lipschitz Regularization |
| topic | Quantum Physics Machine Learning |
| url | https://arxiv.org/abs/2410.21117 |