Integrating Neural Networks and Tensor Networks for Computing Free Energy

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Cao, Hanyan, Wang, Yijia, Pan, Feng, Zhang, Pan
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910912665878528
author Cao, Hanyan
Wang, Yijia
Pan, Feng
Zhang, Pan
author_facet Cao, Hanyan
Wang, Yijia
Pan, Feng
Zhang, Pan
contents Computing free energy is a fundamental problem in statistical physics. Recently, two distinct methods have been developed and have demonstrated remarkable success: the tensor-network-based contraction method and the neural-network-based variational method. Tensor networks are accu?rate, but their application is often limited to low-dimensional systems due to the high computational complexity in high-dimensional systems. The neural network method applies to systems with general topology. However, as a variational method, it is not as accurate as tensor networks. In this work, we propose an integrated approach, tensor-network-based variational autoregressive networks (TNVAN), that leverages the strengths of both tensor networks and neural networks: combining the variational autoregressive neural network's ability to compute an upper bound on free energy and perform unbiased sampling from the variational distribution with the tensor network's power to accurately compute the partition function for small sub-systems, resulting in a robust method for precisely estimating free energy. To evaluate the proposed approach, we conducted numerical experiments on spin glass systems with various topologies, including two-dimensional lattices, fully connected graphs, and random graphs. Our numerical results demonstrate the superior accuracy of our method compared to existing approaches. In particular, it effectively handles systems with long-range interactions and leverages GPU efficiency without requiring singular value decomposition, indicating great potential in tackling statistical mechanics problems and simulating high-dimensional complex systems through both tensor networks and neural networks.
format Preprint
id arxiv_https___arxiv_org_abs_2504_12037
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Integrating Neural Networks and Tensor Networks for Computing Free Energy
Cao, Hanyan
Wang, Yijia
Pan, Feng
Zhang, Pan
Statistical Mechanics
Computing free energy is a fundamental problem in statistical physics. Recently, two distinct methods have been developed and have demonstrated remarkable success: the tensor-network-based contraction method and the neural-network-based variational method. Tensor networks are accu?rate, but their application is often limited to low-dimensional systems due to the high computational complexity in high-dimensional systems. The neural network method applies to systems with general topology. However, as a variational method, it is not as accurate as tensor networks. In this work, we propose an integrated approach, tensor-network-based variational autoregressive networks (TNVAN), that leverages the strengths of both tensor networks and neural networks: combining the variational autoregressive neural network's ability to compute an upper bound on free energy and perform unbiased sampling from the variational distribution with the tensor network's power to accurately compute the partition function for small sub-systems, resulting in a robust method for precisely estimating free energy. To evaluate the proposed approach, we conducted numerical experiments on spin glass systems with various topologies, including two-dimensional lattices, fully connected graphs, and random graphs. Our numerical results demonstrate the superior accuracy of our method compared to existing approaches. In particular, it effectively handles systems with long-range interactions and leverages GPU efficiency without requiring singular value decomposition, indicating great potential in tackling statistical mechanics problems and simulating high-dimensional complex systems through both tensor networks and neural networks.
title Integrating Neural Networks and Tensor Networks for Computing Free Energy
topic Statistical Mechanics
url https://arxiv.org/abs/2504.12037