Information fusion strategy integrating pre-trained language model and contrastive learning for materials knowledge mining

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Peng, Yongqian, Zhang, Zhouran, Zhang, Longhui, Zhao, Fengyuan, Li, Yahao, Ye, Yicong, Bai, Shuxin
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909649204150272
author Peng, Yongqian
Zhang, Zhouran
Zhang, Longhui
Zhao, Fengyuan
Li, Yahao
Ye, Yicong
Bai, Shuxin
author_facet Peng, Yongqian
Zhang, Zhouran
Zhang, Longhui
Zhao, Fengyuan
Li, Yahao
Ye, Yicong
Bai, Shuxin
contents Machine learning has revolutionized materials design, yet predicting complex properties like alloy ductility remains challenging due to the influence of processing conditions and microstructural features that resist quantification through traditional reductionist approaches. Here, we present an innovative information fusion architecture that integrates domain-specific texts from materials science literature with quantitative physical descriptors to overcome these limitations. Our framework employs MatSciBERT for advanced textual comprehension and incorporates contrastive learning to automatically extract implicit knowledge regarding processing parameters and microstructural characteristics. Through rigorous ablation studies and comparative experiments, the model demonstrates superior performance, achieving coefficient of determination (R2) values of 0.849 and 0.680 on titanium alloy validation set and refractory multi-principal-element alloy test set. This systematic approach provides a holistic framework for property prediction in complex material systems where quantitative descriptors are incomplete and establishes a foundation for knowledge-guided materials design and informatics-driven materials discovery.
format Preprint
id arxiv_https___arxiv_org_abs_2506_12516
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Information fusion strategy integrating pre-trained language model and contrastive learning for materials knowledge mining
Peng, Yongqian
Zhang, Zhouran
Zhang, Longhui
Zhao, Fengyuan
Li, Yahao
Ye, Yicong
Bai, Shuxin
Materials Science
Machine Learning
Machine learning has revolutionized materials design, yet predicting complex properties like alloy ductility remains challenging due to the influence of processing conditions and microstructural features that resist quantification through traditional reductionist approaches. Here, we present an innovative information fusion architecture that integrates domain-specific texts from materials science literature with quantitative physical descriptors to overcome these limitations. Our framework employs MatSciBERT for advanced textual comprehension and incorporates contrastive learning to automatically extract implicit knowledge regarding processing parameters and microstructural characteristics. Through rigorous ablation studies and comparative experiments, the model demonstrates superior performance, achieving coefficient of determination (R2) values of 0.849 and 0.680 on titanium alloy validation set and refractory multi-principal-element alloy test set. This systematic approach provides a holistic framework for property prediction in complex material systems where quantitative descriptors are incomplete and establishes a foundation for knowledge-guided materials design and informatics-driven materials discovery.
title Information fusion strategy integrating pre-trained language model and contrastive learning for materials knowledge mining
topic Materials Science
Machine Learning
url https://arxiv.org/abs/2506.12516