Broken neural scaling laws in materials science

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Großmann, Max, Grunert, Malte, Runge, Erich
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912881581228032
author Großmann, Max
Grunert, Malte
Runge, Erich
author_facet Großmann, Max
Grunert, Malte
Runge, Erich
contents In materials science, data are scarce and expensive to generate, whether computationally or experimentally. Therefore, it is crucial to identify how model performance scales with dataset size and model capacity to distinguish between data- and model-limited regimes. Neural scaling laws provide a framework for quantifying this behavior and guide the design of materials datasets and machine learning architectures. Here, we investigate neural scaling laws for a paradigmatic materials science task: predicting the dielectric function of metals, a high-dimensional response that governs how solids interact with light. Using over 200,000 dielectric functions from high-throughput ab initio calculations, we study two multi-objective graph neural networks trained to predict the frequency-dependent complex interband dielectric function and the Drude frequency. We observe broken neural scaling laws with respect to dataset size, whereas scaling with the number of model parameters follows a simple power law that rapidly saturates.
format Preprint
id arxiv_https___arxiv_org_abs_2602_05702
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Broken neural scaling laws in materials science
Großmann, Max
Grunert, Malte
Runge, Erich
Materials Science
Machine Learning
In materials science, data are scarce and expensive to generate, whether computationally or experimentally. Therefore, it is crucial to identify how model performance scales with dataset size and model capacity to distinguish between data- and model-limited regimes. Neural scaling laws provide a framework for quantifying this behavior and guide the design of materials datasets and machine learning architectures. Here, we investigate neural scaling laws for a paradigmatic materials science task: predicting the dielectric function of metals, a high-dimensional response that governs how solids interact with light. Using over 200,000 dielectric functions from high-throughput ab initio calculations, we study two multi-objective graph neural networks trained to predict the frequency-dependent complex interband dielectric function and the Drude frequency. We observe broken neural scaling laws with respect to dataset size, whereas scaling with the number of model parameters follows a simple power law that rapidly saturates.
title Broken neural scaling laws in materials science
topic Materials Science
Machine Learning
url https://arxiv.org/abs/2602.05702