Random-Matrix-Induced Simplicity Bias in Over-parameterized Variational Quantum Circuits

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Qi, Jun, Yang, Chao-Han Huck, Chen, Pin-Yu, Hsieh, Min-Hsiu
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914233344589824
author Qi, Jun
Yang, Chao-Han Huck
Chen, Pin-Yu
Hsieh, Min-Hsiu
author_facet Qi, Jun
Yang, Chao-Han Huck
Chen, Pin-Yu
Hsieh, Min-Hsiu
contents Over-parameterization is commonly used to increase the expressivity of variational quantum circuits (VQCs), yet deeper and more highly parameterized circuits often exhibit poor trainability and limited generalization. In this work, we provide a theoretical explanation for this phenomenon from a function-class perspective. We show that sufficiently expressive, unstructured variational ansatze enter a Haar-like universality class in which both observable expectation values and parameter gradients concentrate exponentially with system size. As a consequence, the hypothesis class induced by such circuits collapses with high probability to a narrow family of near-constant functions, a phenomenon we term simplicity bias, with barren plateaus arising as a consequence rather than the root cause. Using tools from random matrix theory and concentration of measure, we rigorously characterize this universality class and establish uniform hypothesis-class collapse over finite datasets. We further show that this collapse is not unavoidable: tensor-structured VQCs, including tensor-network-based and tensor-hypernetwork parameterizations, lie outside the Haar-like universality class. By restricting the accessible unitary ensemble through bounded tensor rank or bond dimension, these architectures prevent concentration of measure, preserve output variability for local observables, and retain non-degenerate gradient signals even in over-parameterized regimes. Together, our results unify barren plateaus, expressivity limits, and generalization collapse under a single structural mechanism rooted in random-matrix universality, highlighting the central role of architectural inductive bias in variational quantum algorithms.
format Preprint
id arxiv_https___arxiv_org_abs_2601_01877
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Random-Matrix-Induced Simplicity Bias in Over-parameterized Variational Quantum Circuits
Qi, Jun
Yang, Chao-Han Huck
Chen, Pin-Yu
Hsieh, Min-Hsiu
Quantum Physics
Machine Learning
Mathematical Physics
Over-parameterization is commonly used to increase the expressivity of variational quantum circuits (VQCs), yet deeper and more highly parameterized circuits often exhibit poor trainability and limited generalization. In this work, we provide a theoretical explanation for this phenomenon from a function-class perspective. We show that sufficiently expressive, unstructured variational ansatze enter a Haar-like universality class in which both observable expectation values and parameter gradients concentrate exponentially with system size. As a consequence, the hypothesis class induced by such circuits collapses with high probability to a narrow family of near-constant functions, a phenomenon we term simplicity bias, with barren plateaus arising as a consequence rather than the root cause. Using tools from random matrix theory and concentration of measure, we rigorously characterize this universality class and establish uniform hypothesis-class collapse over finite datasets. We further show that this collapse is not unavoidable: tensor-structured VQCs, including tensor-network-based and tensor-hypernetwork parameterizations, lie outside the Haar-like universality class. By restricting the accessible unitary ensemble through bounded tensor rank or bond dimension, these architectures prevent concentration of measure, preserve output variability for local observables, and retain non-degenerate gradient signals even in over-parameterized regimes. Together, our results unify barren plateaus, expressivity limits, and generalization collapse under a single structural mechanism rooted in random-matrix universality, highlighting the central role of architectural inductive bias in variational quantum algorithms.
title Random-Matrix-Induced Simplicity Bias in Over-parameterized Variational Quantum Circuits
topic Quantum Physics
Machine Learning
Mathematical Physics
url https://arxiv.org/abs/2601.01877