Practical Hybrid Quantum Language Models with Observable Readout on Real Hardware

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Balauca, Stefan, Balauca, Ada-Astrid, Iftene, Adrian
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911318437527552
author Balauca, Stefan
Balauca, Ada-Astrid
Iftene, Adrian
author_facet Balauca, Stefan
Balauca, Ada-Astrid
Iftene, Adrian
contents Hybrid quantum-classical models represent a crucial step toward leveraging near-term quantum devices for sequential data processing. We present Quantum Recurrent Neural Networks (QRNNs) and Quantum Convolutional Neural Networks (QCNNs) as hybrid quantum language models, reporting the first empirical demonstration of generative language modeling trained and evaluated end-to-end on real quantum hardware. Our architecture combines hardware-optimized parametric quantum circuits with a lightweight classical projection layer, utilizing a multi-sample SPSA strategy to efficiently train quantum parameters despite hardware noise. To characterize the capabilities of these models, we introduce a synthetic dataset designed to isolate syntactic dependencies in a controlled, low-resource environment. Experiments on IBM Quantum processors reveal the critical trade-offs between circuit depth and trainability, demonstrating that while noise remains a significant factor, observable-based readout enables the successful learning of sequential patterns on NISQ devices. These results establish a rigorous engineering baseline for generative quantum natural language processing, validating the feasibility of training complex sequence models on current quantum hardware.
format Preprint
id arxiv_https___arxiv_org_abs_2512_12710
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Practical Hybrid Quantum Language Models with Observable Readout on Real Hardware
Balauca, Stefan
Balauca, Ada-Astrid
Iftene, Adrian
Quantum Physics
Machine Learning
Hybrid quantum-classical models represent a crucial step toward leveraging near-term quantum devices for sequential data processing. We present Quantum Recurrent Neural Networks (QRNNs) and Quantum Convolutional Neural Networks (QCNNs) as hybrid quantum language models, reporting the first empirical demonstration of generative language modeling trained and evaluated end-to-end on real quantum hardware. Our architecture combines hardware-optimized parametric quantum circuits with a lightweight classical projection layer, utilizing a multi-sample SPSA strategy to efficiently train quantum parameters despite hardware noise. To characterize the capabilities of these models, we introduce a synthetic dataset designed to isolate syntactic dependencies in a controlled, low-resource environment. Experiments on IBM Quantum processors reveal the critical trade-offs between circuit depth and trainability, demonstrating that while noise remains a significant factor, observable-based readout enables the successful learning of sequential patterns on NISQ devices. These results establish a rigorous engineering baseline for generative quantum natural language processing, validating the feasibility of training complex sequence models on current quantum hardware.
title Practical Hybrid Quantum Language Models with Observable Readout on Real Hardware
topic Quantum Physics
Machine Learning
url https://arxiv.org/abs/2512.12710