On quantum backpropagation, information reuse, and cheating measurement collapse
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914708431306752 |
|---|---|
| author | Abbas, Amira King, Robbie Huang, Hsin-Yuan Huggins, William J. Movassagh, Ramis Gilboa, Dar McClean, Jarrod R. |
| author_facet | Abbas, Amira King, Robbie Huang, Hsin-Yuan Huggins, William J. Movassagh, Ramis Gilboa, Dar McClean, Jarrod R. |
| contents | The success of modern deep learning hinges on the ability to train neural networks at scale. Through clever reuse of intermediate information, backpropagation facilitates training through gradient computation at a total cost roughly proportional to running the function, rather than incurring an additional factor proportional to the number of parameters - which can now be in the trillions. Naively, one expects that quantum measurement collapse entirely rules out the reuse of quantum information as in backpropagation. But recent developments in shadow tomography, which assumes access to multiple copies of a quantum state, have challenged that notion. Here, we investigate whether parameterized quantum models can train as efficiently as classical neural networks. We show that achieving backpropagation scaling is impossible without access to multiple copies of a state. With this added ability, we introduce an algorithm with foundations in shadow tomography that matches backpropagation scaling in quantum resources while reducing classical auxiliary computational costs to open problems in shadow tomography. These results highlight the nuance of reusing quantum information for practical purposes and clarify the unique difficulties in training large quantum models, which could alter the course of quantum machine learning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_13362 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | On quantum backpropagation, information reuse, and cheating measurement collapse Abbas, Amira King, Robbie Huang, Hsin-Yuan Huggins, William J. Movassagh, Ramis Gilboa, Dar McClean, Jarrod R. Quantum Physics Machine Learning The success of modern deep learning hinges on the ability to train neural networks at scale. Through clever reuse of intermediate information, backpropagation facilitates training through gradient computation at a total cost roughly proportional to running the function, rather than incurring an additional factor proportional to the number of parameters - which can now be in the trillions. Naively, one expects that quantum measurement collapse entirely rules out the reuse of quantum information as in backpropagation. But recent developments in shadow tomography, which assumes access to multiple copies of a quantum state, have challenged that notion. Here, we investigate whether parameterized quantum models can train as efficiently as classical neural networks. We show that achieving backpropagation scaling is impossible without access to multiple copies of a state. With this added ability, we introduce an algorithm with foundations in shadow tomography that matches backpropagation scaling in quantum resources while reducing classical auxiliary computational costs to open problems in shadow tomography. These results highlight the nuance of reusing quantum information for practical purposes and clarify the unique difficulties in training large quantum models, which could alter the course of quantum machine learning. |
| title | On quantum backpropagation, information reuse, and cheating measurement collapse |
| topic | Quantum Physics Machine Learning |
| url | https://arxiv.org/abs/2305.13362 |