Bayesian E(3)-Equivariant Interatomic Potential with Iterative Restratification of Many-body Message Passing

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Willow, Soohaeng Yoo, Park, Tae Hyeon, Sim, Gi Beom, Moon, Sung Wook, Min, Seung Kyu, Yang, D. ChangMo, Kim, Hyun Woo, Lee, Juho, Myung, Chang Woo
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917390610071552
author Willow, Soohaeng Yoo
Park, Tae Hyeon
Sim, Gi Beom
Moon, Sung Wook
Min, Seung Kyu
Yang, D. ChangMo
Kim, Hyun Woo
Lee, Juho
Myung, Chang Woo
author_facet Willow, Soohaeng Yoo
Park, Tae Hyeon
Sim, Gi Beom
Moon, Sung Wook
Min, Seung Kyu
Yang, D. ChangMo
Kim, Hyun Woo
Lee, Juho
Myung, Chang Woo
contents Machine learning potentials (MLPs) have become essential for large-scale atomistic simulations, enabling ab initio-level accuracy with computational efficiency. However, current MLPs struggle with uncertainty quantification, limiting their reliability for active learning, calibration, and out-of-distribution (OOD) detection. We address these challenges by developing Bayesian E(3) equivariant MLPs with iterative restratification of many-body message passing. Our approach introduces the joint energy-force negative log-likelihood (NLL$_\text{JEF}$) loss function, which explicitly models uncertainty in both energies and interatomic forces, yielding substantially improved accuracy compared to conventional NLL losses. We systematically benchmark multiple Bayesian approaches, including deep ensembles with mean-variance estimation, stochastic weight averaging Gaussian, improved variational online Newton, and Laplace approximation by evaluating their performance on uncertainty prediction, OOD detection, calibration, and active learning tasks. We further demonstrate that NLL$_\text{JEF}$ facilitates efficient active learning by quantifying energy and force uncertainties. Using Bayesian active learning by disagreement (BALD), our framework outperforms random sampling and energy-uncertainty-based sampling. Our results demonstrate that Bayesian MLPs achieve competitive accuracy with state-of-the-art models while enabling uncertainty-guided active learning, OOD detection, and energy/forces calibration. This work establishes Bayesian equivariant neural networks as a powerful framework for developing uncertainty-aware MLPs for atomistic simulations at scale.
format Preprint
id arxiv_https___arxiv_org_abs_2510_03046
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bayesian E(3)-Equivariant Interatomic Potential with Iterative Restratification of Many-body Message Passing
Willow, Soohaeng Yoo
Park, Tae Hyeon
Sim, Gi Beom
Moon, Sung Wook
Min, Seung Kyu
Yang, D. ChangMo
Kim, Hyun Woo
Lee, Juho
Myung, Chang Woo
Machine Learning
Machine learning potentials (MLPs) have become essential for large-scale atomistic simulations, enabling ab initio-level accuracy with computational efficiency. However, current MLPs struggle with uncertainty quantification, limiting their reliability for active learning, calibration, and out-of-distribution (OOD) detection. We address these challenges by developing Bayesian E(3) equivariant MLPs with iterative restratification of many-body message passing. Our approach introduces the joint energy-force negative log-likelihood (NLL$_\text{JEF}$) loss function, which explicitly models uncertainty in both energies and interatomic forces, yielding substantially improved accuracy compared to conventional NLL losses. We systematically benchmark multiple Bayesian approaches, including deep ensembles with mean-variance estimation, stochastic weight averaging Gaussian, improved variational online Newton, and Laplace approximation by evaluating their performance on uncertainty prediction, OOD detection, calibration, and active learning tasks. We further demonstrate that NLL$_\text{JEF}$ facilitates efficient active learning by quantifying energy and force uncertainties. Using Bayesian active learning by disagreement (BALD), our framework outperforms random sampling and energy-uncertainty-based sampling. Our results demonstrate that Bayesian MLPs achieve competitive accuracy with state-of-the-art models while enabling uncertainty-guided active learning, OOD detection, and energy/forces calibration. This work establishes Bayesian equivariant neural networks as a powerful framework for developing uncertainty-aware MLPs for atomistic simulations at scale.
title Bayesian E(3)-Equivariant Interatomic Potential with Iterative Restratification of Many-body Message Passing
topic Machine Learning
url https://arxiv.org/abs/2510.03046