Message Passing Variational Autoregressive Network for Solving Intractable Ising Models

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ma, Qunlong, Ma, Zhi, Xu, Jinlong, Zhang, Hairui, Gao, Ming
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929595984379904
author Ma, Qunlong
Ma, Zhi
Xu, Jinlong
Zhang, Hairui
Gao, Ming
author_facet Ma, Qunlong
Ma, Zhi
Xu, Jinlong
Zhang, Hairui
Gao, Ming
contents Many deep neural networks have been used to solve Ising models, including autoregressive neural networks, convolutional neural networks, recurrent neural networks, and graph neural networks. Learning a probability distribution of energy configuration or finding the ground states of a disordered, fully connected Ising model is essential for statistical mechanics and NP-hard problems. Despite tremendous efforts, a neural network architecture with the ability to high-accurately solve these fully connected and extremely intractable problems on larger systems is still lacking. Here we propose a variational autoregressive architecture with a message passing mechanism, which can effectively utilize the interactions between spin variables. The new network trained under an annealing framework outperforms existing methods in solving several prototypical Ising spin Hamiltonians, especially for larger spin systems at low temperatures. The advantages also come from the great mitigation of mode collapse during the training process of deep neural networks. Considering these extremely difficult problems to be solved, our method extends the current computational limits of unsupervised neural networks to solve combinatorial optimization problems.
format Preprint
id arxiv_https___arxiv_org_abs_2404_06225
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Message Passing Variational Autoregressive Network for Solving Intractable Ising Models
Ma, Qunlong
Ma, Zhi
Xu, Jinlong
Zhang, Hairui
Gao, Ming
Statistical Mechanics
Disordered Systems and Neural Networks
Machine Learning
Many deep neural networks have been used to solve Ising models, including autoregressive neural networks, convolutional neural networks, recurrent neural networks, and graph neural networks. Learning a probability distribution of energy configuration or finding the ground states of a disordered, fully connected Ising model is essential for statistical mechanics and NP-hard problems. Despite tremendous efforts, a neural network architecture with the ability to high-accurately solve these fully connected and extremely intractable problems on larger systems is still lacking. Here we propose a variational autoregressive architecture with a message passing mechanism, which can effectively utilize the interactions between spin variables. The new network trained under an annealing framework outperforms existing methods in solving several prototypical Ising spin Hamiltonians, especially for larger spin systems at low temperatures. The advantages also come from the great mitigation of mode collapse during the training process of deep neural networks. Considering these extremely difficult problems to be solved, our method extends the current computational limits of unsupervised neural networks to solve combinatorial optimization problems.
title Message Passing Variational Autoregressive Network for Solving Intractable Ising Models
topic Statistical Mechanics
Disordered Systems and Neural Networks
Machine Learning
url https://arxiv.org/abs/2404.06225