MolX: Enhancing Large Language Models for Molecular Understanding With A Multi-Modal Extension
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910005095038976 |
|---|---|
| author | Le, Khiem Guo, Zhichun Dong, Kaiwen Huang, Xiaobao Nan, Bozhao Iyer, Roshni Zhang, Xiangliang Wiest, Olaf Wang, Wei Hua, Ting Chawla, Nitesh V. |
| author_facet | Le, Khiem Guo, Zhichun Dong, Kaiwen Huang, Xiaobao Nan, Bozhao Iyer, Roshni Zhang, Xiangliang Wiest, Olaf Wang, Wei Hua, Ting Chawla, Nitesh V. |
| contents | Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain remains restricted, especially in solving molecule-related tasks. This challenge is attributed to their inherent limitations in comprehending molecules using only common textual representations, i.e. SMILES strings. In this study, we seek to enhance the ability of LLMs to comprehend molecules by equipping them with a multi-modal external module, termed MolX. Instead of directly using SMILES strings to represent a molecule, we utilize specific encoders to extract fine-grained features from both SMILES string and 2D molecular graph representations for feeding into an LLM. A hand-crafted molecular fingerprint is incorporated to leverage its embedded domain knowledge. To establish an alignment between MolX and the LLM's textual input space, the model in which the LLM is frozen, is pre-trained with a strategy including a diverse set of tasks. Experimental evaluations show that our proposed method outperforms baselines across downstream molecule-related tasks ranging from molecule-to-text translation to molecular property prediction, with and without fine-tuning the LLM, while only introducing a small number of trainable parameters-0.53% and 0.82%, respectively. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_06777 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MolX: Enhancing Large Language Models for Molecular Understanding With A Multi-Modal Extension Le, Khiem Guo, Zhichun Dong, Kaiwen Huang, Xiaobao Nan, Bozhao Iyer, Roshni Zhang, Xiangliang Wiest, Olaf Wang, Wei Hua, Ting Chawla, Nitesh V. Computer Vision and Pattern Recognition Artificial Intelligence Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain remains restricted, especially in solving molecule-related tasks. This challenge is attributed to their inherent limitations in comprehending molecules using only common textual representations, i.e. SMILES strings. In this study, we seek to enhance the ability of LLMs to comprehend molecules by equipping them with a multi-modal external module, termed MolX. Instead of directly using SMILES strings to represent a molecule, we utilize specific encoders to extract fine-grained features from both SMILES string and 2D molecular graph representations for feeding into an LLM. A hand-crafted molecular fingerprint is incorporated to leverage its embedded domain knowledge. To establish an alignment between MolX and the LLM's textual input space, the model in which the LLM is frozen, is pre-trained with a strategy including a diverse set of tasks. Experimental evaluations show that our proposed method outperforms baselines across downstream molecule-related tasks ranging from molecule-to-text translation to molecular property prediction, with and without fine-tuning the LLM, while only introducing a small number of trainable parameters-0.53% and 0.82%, respectively. |
| title | MolX: Enhancing Large Language Models for Molecular Understanding With A Multi-Modal Extension |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2406.06777 |