Self-supervised Representations and Node Embedding Graph Neural Networks for Accurate and Multi-scale Analysis of Materials

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Kong, Jian-Gang, Zhao, Ke-Lin, Li, Jian, Li, Qing-Xu, Liu, Yu, Zhang, Rui, Zhu, Jia-Ji, Chang, Kai
Formato: Preprint
Publicado: 2022
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908372460109824
author Kong, Jian-Gang
Zhao, Ke-Lin
Li, Jian
Li, Qing-Xu
Liu, Yu
Zhang, Rui
Zhu, Jia-Ji
Chang, Kai
author_facet Kong, Jian-Gang
Zhao, Ke-Lin
Li, Jian
Li, Qing-Xu
Liu, Yu
Zhang, Rui
Zhu, Jia-Ji
Chang, Kai
contents Supervised machine learning algorithms, such as graph neural networks (GNN), have successfully predicted material properties. However, the superior performance of GNN usually relies on end-to-end learning on large material datasets, which may lose the physical insight of multi-scale information about materials. And the process of labeling data consumes many resources and inevitably introduces errors, which constrains the accuracy of prediction. We propose to train the GNN model by self-supervised learning on the node and edge information of the crystal graph. Compared with the popular manually constructed material descriptors, the self-supervised atomic representation can reach better prediction performance on material properties. Furthermore, it may provide physical insights by tuning the range information. Applying the self-supervised atomic representation on the magnetic moment datasets, we show how they can extract rules and information from the magnetic materials. To incorporate rich physical information into the GNN model, we develop the node embedding graph neural networks (NEGNN) framework and show significant improvements in the prediction performance. The self-supervised material representation and the NEGNN framework may investigate in-depth information from materials and can be applied to small datasets with increased prediction accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2211_03563
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Self-supervised Representations and Node Embedding Graph Neural Networks for Accurate and Multi-scale Analysis of Materials
Kong, Jian-Gang
Zhao, Ke-Lin
Li, Jian
Li, Qing-Xu
Liu, Yu
Zhang, Rui
Zhu, Jia-Ji
Chang, Kai
Materials Science
Computational Physics
Supervised machine learning algorithms, such as graph neural networks (GNN), have successfully predicted material properties. However, the superior performance of GNN usually relies on end-to-end learning on large material datasets, which may lose the physical insight of multi-scale information about materials. And the process of labeling data consumes many resources and inevitably introduces errors, which constrains the accuracy of prediction. We propose to train the GNN model by self-supervised learning on the node and edge information of the crystal graph. Compared with the popular manually constructed material descriptors, the self-supervised atomic representation can reach better prediction performance on material properties. Furthermore, it may provide physical insights by tuning the range information. Applying the self-supervised atomic representation on the magnetic moment datasets, we show how they can extract rules and information from the magnetic materials. To incorporate rich physical information into the GNN model, we develop the node embedding graph neural networks (NEGNN) framework and show significant improvements in the prediction performance. The self-supervised material representation and the NEGNN framework may investigate in-depth information from materials and can be applied to small datasets with increased prediction accuracy.
title Self-supervised Representations and Node Embedding Graph Neural Networks for Accurate and Multi-scale Analysis of Materials
topic Materials Science
Computational Physics
url https://arxiv.org/abs/2211.03563