Empirical Evidence for the Fragment level Understanding on Drug Molecular Structure of LLMs
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916092038873088 |
|---|---|
| author | Hu, Xiuyuan Liu, Guoqing Zhao, Yang Zhang, Hao |
| author_facet | Hu, Xiuyuan Liu, Guoqing Zhao, Yang Zhang, Hao |
| contents | AI for drug discovery has been a research hotspot in recent years, and SMILES-based language models has been increasingly applied in drug molecular design. However, no work has explored whether and how language models understand the chemical spatial structure from 1D sequences. In this work, we pre-train a transformer model on chemical language and fine-tune it toward drug design objectives, and investigate the correspondence between high-frequency SMILES substrings and molecular fragments. The results indicate that language models can understand chemical structures from the perspective of molecular fragments, and the structural knowledge learned through fine-tuning is reflected in the high-frequency SMILES substrings generated by the model. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_07657 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Empirical Evidence for the Fragment level Understanding on Drug Molecular Structure of LLMs Hu, Xiuyuan Liu, Guoqing Zhao, Yang Zhang, Hao Machine Learning Computational Engineering, Finance, and Science Biomolecules AI for drug discovery has been a research hotspot in recent years, and SMILES-based language models has been increasingly applied in drug molecular design. However, no work has explored whether and how language models understand the chemical spatial structure from 1D sequences. In this work, we pre-train a transformer model on chemical language and fine-tune it toward drug design objectives, and investigate the correspondence between high-frequency SMILES substrings and molecular fragments. The results indicate that language models can understand chemical structures from the perspective of molecular fragments, and the structural knowledge learned through fine-tuning is reflected in the high-frequency SMILES substrings generated by the model. |
| title | Empirical Evidence for the Fragment level Understanding on Drug Molecular Structure of LLMs |
| topic | Machine Learning Computational Engineering, Finance, and Science Biomolecules |
| url | https://arxiv.org/abs/2401.07657 |