Quantum Attention for Vision Transformers in High Energy Physics
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913581995393024 |
|---|---|
| author | Tesi, Alessandro Dahale, Gopal Ramesh Gleyzer, Sergei Kong, Kyoungchul Magorsch, Tom Matchev, Konstantin T. Matcheva, Katia |
| author_facet | Tesi, Alessandro Dahale, Gopal Ramesh Gleyzer, Sergei Kong, Kyoungchul Magorsch, Tom Matchev, Konstantin T. Matcheva, Katia |
| contents | We present a novel hybrid quantum-classical vision transformer architecture incorporating quantum orthogonal neural networks (QONNs) to enhance performance and computational efficiency in high-energy physics applications. Building on advancements in quantum vision transformers, our approach addresses limitations of prior models by leveraging the inherent advantages of QONNs, including stability and efficient parameterization in high-dimensional spaces. We evaluate the proposed architecture using multi-detector jet images from CMS Open Data, focusing on the task of distinguishing quark-initiated from gluon-initiated jets. The results indicate that embedding quantum orthogonal transformations within the attention mechanism can provide robust performance while offering promising scalability for machine learning challenges associated with the upcoming High Luminosity Large Hadron Collider. This work highlights the potential of quantum-enhanced models to address the computational demands of next-generation particle physics experiments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_13520 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Quantum Attention for Vision Transformers in High Energy Physics Tesi, Alessandro Dahale, Gopal Ramesh Gleyzer, Sergei Kong, Kyoungchul Magorsch, Tom Matchev, Konstantin T. Matcheva, Katia Quantum Physics Machine Learning High Energy Physics - Experiment High Energy Physics - Phenomenology We present a novel hybrid quantum-classical vision transformer architecture incorporating quantum orthogonal neural networks (QONNs) to enhance performance and computational efficiency in high-energy physics applications. Building on advancements in quantum vision transformers, our approach addresses limitations of prior models by leveraging the inherent advantages of QONNs, including stability and efficient parameterization in high-dimensional spaces. We evaluate the proposed architecture using multi-detector jet images from CMS Open Data, focusing on the task of distinguishing quark-initiated from gluon-initiated jets. The results indicate that embedding quantum orthogonal transformations within the attention mechanism can provide robust performance while offering promising scalability for machine learning challenges associated with the upcoming High Luminosity Large Hadron Collider. This work highlights the potential of quantum-enhanced models to address the computational demands of next-generation particle physics experiments. |
| title | Quantum Attention for Vision Transformers in High Energy Physics |
| topic | Quantum Physics Machine Learning High Energy Physics - Experiment High Energy Physics - Phenomenology |
| url | https://arxiv.org/abs/2411.13520 |