Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, He, Liu, Chang, Wang, Zun, Wei, Xinran, Liu, Siyuan, Zheng, Nanning, Shao, Bin, Liu, Tie-Yan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910472347844608
author Zhang, He
Liu, Chang
Wang, Zun
Wei, Xinran
Liu, Siyuan
Zheng, Nanning
Shao, Bin
Liu, Tie-Yan
author_facet Zhang, He
Liu, Chang
Wang, Zun
Wei, Xinran
Liu, Siyuan
Zheng, Nanning
Shao, Bin
Liu, Tie-Yan
contents Predicting the mean-field Hamiltonian matrix in density functional theory is a fundamental formulation to leverage machine learning for solving molecular science problems. Yet, its applicability is limited by insufficient labeled data for training. In this work, we highlight that Hamiltonian prediction possesses a self-consistency principle, based on which we propose self-consistency training, an exact training method that does not require labeled data. It distinguishes the task from predicting other molecular properties by the following benefits: (1) it enables the model to be trained on a large amount of unlabeled data, hence addresses the data scarcity challenge and enhances generalization; (2) it is more efficient than running DFT to generate labels for supervised training, since it amortizes DFT calculation over a set of queries. We empirically demonstrate the better generalization in data-scarce and out-of-distribution scenarios, and the better efficiency over DFT labeling. These benefits push forward the applicability of Hamiltonian prediction to an ever-larger scale.
format Preprint
id arxiv_https___arxiv_org_abs_2403_09560
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction
Zhang, He
Liu, Chang
Wang, Zun
Wei, Xinran
Liu, Siyuan
Zheng, Nanning
Shao, Bin
Liu, Tie-Yan
Machine Learning
Chemical Physics
Biomolecules
Predicting the mean-field Hamiltonian matrix in density functional theory is a fundamental formulation to leverage machine learning for solving molecular science problems. Yet, its applicability is limited by insufficient labeled data for training. In this work, we highlight that Hamiltonian prediction possesses a self-consistency principle, based on which we propose self-consistency training, an exact training method that does not require labeled data. It distinguishes the task from predicting other molecular properties by the following benefits: (1) it enables the model to be trained on a large amount of unlabeled data, hence addresses the data scarcity challenge and enhances generalization; (2) it is more efficient than running DFT to generate labels for supervised training, since it amortizes DFT calculation over a set of queries. We empirically demonstrate the better generalization in data-scarce and out-of-distribution scenarios, and the better efficiency over DFT labeling. These benefits push forward the applicability of Hamiltonian prediction to an ever-larger scale.
title Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction
topic Machine Learning
Chemical Physics
Biomolecules
url https://arxiv.org/abs/2403.09560