DrugLLM: Open Large Language Model for Few-shot Molecule Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liu, Xianggen, Guo, Yan, Li, Haoran, Liu, Jin, Huang, Shudong, Ke, Bowen, Lv, Jiancheng
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916241999921152
author Liu, Xianggen
Guo, Yan
Li, Haoran
Liu, Jin
Huang, Shudong
Ke, Bowen
Lv, Jiancheng
author_facet Liu, Xianggen
Guo, Yan
Li, Haoran
Liu, Jin
Huang, Shudong
Ke, Bowen
Lv, Jiancheng
contents Large Language Models (LLMs) have made great strides in areas such as language processing and computer vision. Despite the emergence of diverse techniques to improve few-shot learning capacity, current LLMs fall short in handling the languages in biology and chemistry. For example, they are struggling to capture the relationship between molecule structure and pharmacochemical properties. Consequently, the few-shot learning capacity of small-molecule drug modification remains impeded. In this work, we introduced DrugLLM, a LLM tailored for drug design. During the training process, we employed Group-based Molecular Representation (GMR) to represent molecules, arranging them in sequences that reflect modifications aimed at enhancing specific molecular properties. DrugLLM learns how to modify molecules in drug discovery by predicting the next molecule based on past modifications. Extensive computational experiments demonstrate that DrugLLM can generate new molecules with expected properties based on limited examples, presenting a powerful few-shot molecule generation capacity.
format Preprint
id arxiv_https___arxiv_org_abs_2405_06690
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DrugLLM: Open Large Language Model for Few-shot Molecule Generation
Liu, Xianggen
Guo, Yan
Li, Haoran
Liu, Jin
Huang, Shudong
Ke, Bowen
Lv, Jiancheng
Biomolecules
Computation and Language
Machine Learning
Large Language Models (LLMs) have made great strides in areas such as language processing and computer vision. Despite the emergence of diverse techniques to improve few-shot learning capacity, current LLMs fall short in handling the languages in biology and chemistry. For example, they are struggling to capture the relationship between molecule structure and pharmacochemical properties. Consequently, the few-shot learning capacity of small-molecule drug modification remains impeded. In this work, we introduced DrugLLM, a LLM tailored for drug design. During the training process, we employed Group-based Molecular Representation (GMR) to represent molecules, arranging them in sequences that reflect modifications aimed at enhancing specific molecular properties. DrugLLM learns how to modify molecules in drug discovery by predicting the next molecule based on past modifications. Extensive computational experiments demonstrate that DrugLLM can generate new molecules with expected properties based on limited examples, presenting a powerful few-shot molecule generation capacity.
title DrugLLM: Open Large Language Model for Few-shot Molecule Generation
topic Biomolecules
Computation and Language
Machine Learning
url https://arxiv.org/abs/2405.06690