High Entropy Alloy property predictions using Transformer-based language model

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kamnis, Spyros, Delibasis, Konstantinos
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917830447857664
author Kamnis, Spyros
Delibasis, Konstantinos
author_facet Kamnis, Spyros
Delibasis, Konstantinos
contents This study introduces a language transformer-based machine learning model to predict key mechanical properties of high-entropy alloys (HEAs), addressing the challenges due to their complex, multi-principal element compositions and limited experimental data. By pre-training the transformer on extensive synthetic materials data and fine-tuning it with specific HEA datasets, the model effectively captures intricate elemental interactions through self-attention mechanisms. This approach mitigates data scarcity issues via transfer learning, enhancing predictive accuracy for properties like elongation (%) and ultimate tensile strength (UTS) compared to traditional regression models such as Random Forests and Gaussian Processes. The model's interpretability is enhanced by visualizing attention weights, revealing significant elemental relationships that align with known metallurgical principles. This work demonstrates the potential of transformer models to accelerate materials discovery and optimization, enabling accurate property predictions, thereby advancing the field of materials informatics.
format Preprint
id arxiv_https___arxiv_org_abs_2411_04861
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle High Entropy Alloy property predictions using Transformer-based language model
Kamnis, Spyros
Delibasis, Konstantinos
Computational Engineering, Finance, and Science
This study introduces a language transformer-based machine learning model to predict key mechanical properties of high-entropy alloys (HEAs), addressing the challenges due to their complex, multi-principal element compositions and limited experimental data. By pre-training the transformer on extensive synthetic materials data and fine-tuning it with specific HEA datasets, the model effectively captures intricate elemental interactions through self-attention mechanisms. This approach mitigates data scarcity issues via transfer learning, enhancing predictive accuracy for properties like elongation (%) and ultimate tensile strength (UTS) compared to traditional regression models such as Random Forests and Gaussian Processes. The model's interpretability is enhanced by visualizing attention weights, revealing significant elemental relationships that align with known metallurgical principles. This work demonstrates the potential of transformer models to accelerate materials discovery and optimization, enabling accurate property predictions, thereby advancing the field of materials informatics.
title High Entropy Alloy property predictions using Transformer-based language model
topic Computational Engineering, Finance, and Science
url https://arxiv.org/abs/2411.04861