Salvato in:
Dettagli Bibliografici
Autori principali: Tang, Yingheng, Xu, Wenbin, Cao, Jie, Gao, Weilu, Farrell, Steve, Erichson, Benjamin, Mahoney, Michael W., Nonaka, Andy, Yao, Zhi
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2502.13107
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917999637692416
author Tang, Yingheng
Xu, Wenbin
Cao, Jie
Gao, Weilu
Farrell, Steve
Erichson, Benjamin
Mahoney, Michael W.
Nonaka, Andy
Yao, Zhi
author_facet Tang, Yingheng
Xu, Wenbin
Cao, Jie
Gao, Weilu
Farrell, Steve
Erichson, Benjamin
Mahoney, Michael W.
Nonaka, Andy
Yao, Zhi
contents Understanding and predicting the properties of inorganic materials is crucial for accelerating advancements in materials science and driving applications in energy, electronics, and beyond. Integrating material structure data with language-based information through multi-modal large language models (LLMs) offers great potential to support these efforts by enhancing human-AI interaction. However, a key challenge lies in integrating atomic structures at full resolution into LLMs. In this work, we introduce MatterChat, a versatile structure-aware multi-modal LLM that unifies material structural data and textual inputs into a single cohesive model. MatterChat employs a bridging module to effectively align a pretrained machine learning interatomic potential with a pretrained LLM, reducing training costs and enhancing flexibility. Our results demonstrate that MatterChat significantly improves performance in material property prediction and human-AI interaction, surpassing general-purpose LLMs such as GPT-4. We also demonstrate its usefulness in applications such as more advanced scientific reasoning and step-by-step material synthesis.
format Preprint
id arxiv_https___arxiv_org_abs_2502_13107
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MatterChat: A Multi-Modal LLM for Material Science
Tang, Yingheng
Xu, Wenbin
Cao, Jie
Gao, Weilu
Farrell, Steve
Erichson, Benjamin
Mahoney, Michael W.
Nonaka, Andy
Yao, Zhi
Artificial Intelligence
Machine Learning
Understanding and predicting the properties of inorganic materials is crucial for accelerating advancements in materials science and driving applications in energy, electronics, and beyond. Integrating material structure data with language-based information through multi-modal large language models (LLMs) offers great potential to support these efforts by enhancing human-AI interaction. However, a key challenge lies in integrating atomic structures at full resolution into LLMs. In this work, we introduce MatterChat, a versatile structure-aware multi-modal LLM that unifies material structural data and textual inputs into a single cohesive model. MatterChat employs a bridging module to effectively align a pretrained machine learning interatomic potential with a pretrained LLM, reducing training costs and enhancing flexibility. Our results demonstrate that MatterChat significantly improves performance in material property prediction and human-AI interaction, surpassing general-purpose LLMs such as GPT-4. We also demonstrate its usefulness in applications such as more advanced scientific reasoning and step-by-step material synthesis.
title MatterChat: A Multi-Modal LLM for Material Science
topic Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2502.13107