The Spectral Amplitude Principle for Dynamics of Quantum Neural Networks
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866918262218948608 |
|---|---|
| author | Xu, Yi-hang Zhang, Dan-Bo Yan, Junchi |
| author_facet | Xu, Yi-hang Zhang, Dan-Bo Yan, Junchi |
| contents | The mechanism governing the training dynamics of Quantum Neural Networks (QNNs) remains under-explored. In classical Deep Neural Networks (DNNs), training is dominated by "Spectral Bias," i.e. prioritizing learning low-frequency components and struggle for high-frequency details. In this work, we theoretically and empirically identify a distinct mechanism in QNNs, which we term Spectral Amplitude Priority. By analyzing the frequency-domain gradients and residual dynamics via the Quantum Neural Tangent Kernel (QNTK), we prove that QNN training is governed primarily by the magnitude of spectral components rather than their frequency indices. Consequently, QNNs can efficiently capture high-frequency functions-provided they have significant amplitude-thereby overcoming the inherent limitations of their classical counterparts. We validate this principle on both synthetic high-frequency functions and quantum-advantage tasks. The results show that QNNs significantly outperform DNNs in high-frequency tasks, offering an explanation for QNNs' superior expressivity in complex spectral landscapes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_06682 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The Spectral Amplitude Principle for Dynamics of Quantum Neural Networks Xu, Yi-hang Zhang, Dan-Bo Yan, Junchi Quantum Physics The mechanism governing the training dynamics of Quantum Neural Networks (QNNs) remains under-explored. In classical Deep Neural Networks (DNNs), training is dominated by "Spectral Bias," i.e. prioritizing learning low-frequency components and struggle for high-frequency details. In this work, we theoretically and empirically identify a distinct mechanism in QNNs, which we term Spectral Amplitude Priority. By analyzing the frequency-domain gradients and residual dynamics via the Quantum Neural Tangent Kernel (QNTK), we prove that QNN training is governed primarily by the magnitude of spectral components rather than their frequency indices. Consequently, QNNs can efficiently capture high-frequency functions-provided they have significant amplitude-thereby overcoming the inherent limitations of their classical counterparts. We validate this principle on both synthetic high-frequency functions and quantum-advantage tasks. The results show that QNNs significantly outperform DNNs in high-frequency tasks, offering an explanation for QNNs' superior expressivity in complex spectral landscapes. |
| title | The Spectral Amplitude Principle for Dynamics of Quantum Neural Networks |
| topic | Quantum Physics |
| url | https://arxiv.org/abs/2409.06682 |