Transferability of Atom-Based Neural Networks

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kjeldal, Frederik Ø., Eriksen, Janus J.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913519432105984
author Kjeldal, Frederik Ø.
Eriksen, Janus J.
author_facet Kjeldal, Frederik Ø.
Eriksen, Janus J.
contents Machine-learning models in chemistry - when based on descriptors of atoms embedded within molecules - face essential challenges in transferring the quality of predictions of local electronic structures and their associated properties across chemical compound space. In the present work, we make use of adversarial validation to elucidate certain intrinsic complications related to machine inferences of unseen chemistry. On this basis, we employ invariant and equivariant neural networks - both trained either exclusively on total molecular energies or a combination of these and data from atomic partitioning schemes - to evaluate how such models scale performance-wise between datasets of fundamentally different functionality and composition. We find the inference of local electronic properties to improve significantly when training models on augmented data that appropriately expose local functional features. However, molecular datasets for training purposes must themselves be sufficiently comprehensive and rich in composition to warrant any generalizations to larger systems, and even then, transferability can still only genuinely manifest if the body of atomic energies available for training purposes exposes the uniqueness of different functional moieties within molecules. We demonstrate this point by comparing machine models trained on atomic partitioning schemes based on the spatial locality of either native atomic or molecular orbitals.
format Preprint
id arxiv_https___arxiv_org_abs_2409_17575
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Transferability of Atom-Based Neural Networks
Kjeldal, Frederik Ø.
Eriksen, Janus J.
Chemical Physics
Machine-learning models in chemistry - when based on descriptors of atoms embedded within molecules - face essential challenges in transferring the quality of predictions of local electronic structures and their associated properties across chemical compound space. In the present work, we make use of adversarial validation to elucidate certain intrinsic complications related to machine inferences of unseen chemistry. On this basis, we employ invariant and equivariant neural networks - both trained either exclusively on total molecular energies or a combination of these and data from atomic partitioning schemes - to evaluate how such models scale performance-wise between datasets of fundamentally different functionality and composition. We find the inference of local electronic properties to improve significantly when training models on augmented data that appropriately expose local functional features. However, molecular datasets for training purposes must themselves be sufficiently comprehensive and rich in composition to warrant any generalizations to larger systems, and even then, transferability can still only genuinely manifest if the body of atomic energies available for training purposes exposes the uniqueness of different functional moieties within molecules. We demonstrate this point by comparing machine models trained on atomic partitioning schemes based on the spatial locality of either native atomic or molecular orbitals.
title Transferability of Atom-Based Neural Networks
topic Chemical Physics
url https://arxiv.org/abs/2409.17575