Quantum-Enhanced Attention Mechanism in NLP: A Hybrid Classical-Quantum Approach
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913915227602944 |
|---|---|
| author | Tomal, S. M. Yousuf Iqbal Shafin, Abdullah Al Bhattacharjee, Debojit Amin, MD. Khairul Shahir, Rafiad Sadat |
| author_facet | Tomal, S. M. Yousuf Iqbal Shafin, Abdullah Al Bhattacharjee, Debojit Amin, MD. Khairul Shahir, Rafiad Sadat |
| contents | Recent advances in quantum computing have opened new pathways for enhancing deep learning architectures, particularly in domains characterized by high-dimensional and context-rich data such as natural language processing (NLP). In this work, we present a hybrid classical-quantum Transformer model that integrates a quantum-enhanced attention mechanism into the standard classical architecture. By embedding token representations into a quantum Hilbert space via parameterized variational circuits and exploiting entanglement-aware kernel similarities, the model captures complex semantic relationships beyond the reach of conventional dot-product attention. We demonstrate the effectiveness of this approach across diverse NLP benchmarks, showing improvements in both efficiency and representational capacity. The results section reveal that the quantum attention layer yields globally coherent attention maps and more separable latent features, while requiring comparatively fewer parameters than classical counterparts. These findings highlight the potential of quantum-classical hybrid models to serve as a powerful and resource-efficient alternative to existing attention mechanisms in NLP. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_15630 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Quantum-Enhanced Attention Mechanism in NLP: A Hybrid Classical-Quantum Approach Tomal, S. M. Yousuf Iqbal Shafin, Abdullah Al Bhattacharjee, Debojit Amin, MD. Khairul Shahir, Rafiad Sadat Computation and Language Quantum Physics Recent advances in quantum computing have opened new pathways for enhancing deep learning architectures, particularly in domains characterized by high-dimensional and context-rich data such as natural language processing (NLP). In this work, we present a hybrid classical-quantum Transformer model that integrates a quantum-enhanced attention mechanism into the standard classical architecture. By embedding token representations into a quantum Hilbert space via parameterized variational circuits and exploiting entanglement-aware kernel similarities, the model captures complex semantic relationships beyond the reach of conventional dot-product attention. We demonstrate the effectiveness of this approach across diverse NLP benchmarks, showing improvements in both efficiency and representational capacity. The results section reveal that the quantum attention layer yields globally coherent attention maps and more separable latent features, while requiring comparatively fewer parameters than classical counterparts. These findings highlight the potential of quantum-classical hybrid models to serve as a powerful and resource-efficient alternative to existing attention mechanisms in NLP. |
| title | Quantum-Enhanced Attention Mechanism in NLP: A Hybrid Classical-Quantum Approach |
| topic | Computation and Language Quantum Physics |
| url | https://arxiv.org/abs/2501.15630 |