LLM-Fusion: A Novel Multimodal Fusion Model for Accelerated Material Discovery
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915179386634240 |
|---|---|
| author | Boyar, Onur Priyadarsini, Indra Takeda, Seiji Hamada, Lisa |
| author_facet | Boyar, Onur Priyadarsini, Indra Takeda, Seiji Hamada, Lisa |
| contents | Discovering materials with desirable properties in an efficient way remains a significant problem in materials science. Many studies have tackled this problem by using different sets of information available about the materials. Among them, multimodal approaches have been found to be promising because of their ability to combine different sources of information. However, fusion algorithms to date remain simple, lacking a mechanism to provide a rich representation of multiple modalities. This paper presents LLM-Fusion, a novel multimodal fusion model that leverages large language models (LLMs) to integrate diverse representations, such as SMILES, SELFIES, text descriptions, and molecular fingerprints, for accurate property prediction. Our approach introduces a flexible LLM-based architecture that supports multimodal input processing and enables material property prediction with higher accuracy than traditional methods. We validate our model on two datasets across five prediction tasks and demonstrate its effectiveness compared to unimodal and naive concatenation baselines. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_01022 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | LLM-Fusion: A Novel Multimodal Fusion Model for Accelerated Material Discovery Boyar, Onur Priyadarsini, Indra Takeda, Seiji Hamada, Lisa Materials Science Artificial Intelligence Machine Learning Discovering materials with desirable properties in an efficient way remains a significant problem in materials science. Many studies have tackled this problem by using different sets of information available about the materials. Among them, multimodal approaches have been found to be promising because of their ability to combine different sources of information. However, fusion algorithms to date remain simple, lacking a mechanism to provide a rich representation of multiple modalities. This paper presents LLM-Fusion, a novel multimodal fusion model that leverages large language models (LLMs) to integrate diverse representations, such as SMILES, SELFIES, text descriptions, and molecular fingerprints, for accurate property prediction. Our approach introduces a flexible LLM-based architecture that supports multimodal input processing and enables material property prediction with higher accuracy than traditional methods. We validate our model on two datasets across five prediction tasks and demonstrate its effectiveness compared to unimodal and naive concatenation baselines. |
| title | LLM-Fusion: A Novel Multimodal Fusion Model for Accelerated Material Discovery |
| topic | Materials Science Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2503.01022 |