GeLLMO: Generalizing Large Language Models for Multi-property Molecule Optimization

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Dey, Vishal, Hu, Xiao, Ning, Xia
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918035937296384
author Dey, Vishal
Hu, Xiao
Ning, Xia
author_facet Dey, Vishal
Hu, Xiao
Ning, Xia
contents Despite recent advancements, most computational methods for molecule optimization are constrained to single- or double-property optimization tasks and suffer from poor scalability and generalizability to novel optimization tasks. Meanwhile, Large Language Models (LLMs) demonstrate remarkable out-of-domain generalizability to novel tasks. To demonstrate LLMs' potential for molecule optimization, we introduce MuMOInstruct, the first high-quality instruction-tuning dataset specifically focused on complex multi-property molecule optimization tasks. Leveraging MuMOInstruct, we develop GeLLMOs, a series of instruction-tuned LLMs for molecule optimization. Extensive evaluations across 5 in-domain and 5 out-of-domain tasks demonstrate that GeLLMOs consistently outperform state-of-the-art baselines. GeLLMOs also exhibit outstanding zero-shot generalization to unseen tasks, significantly outperforming powerful closed-source LLMs. Such strong generalizability demonstrates the tremendous potential of GeLLMOs as foundational models for molecule optimization, thereby tackling novel optimization tasks without resource-intensive retraining. MuMOInstruct, models, and code are accessible through https://github.com/ninglab/GeLLMO.
format Preprint
id arxiv_https___arxiv_org_abs_2502_13398
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GeLLMO: Generalizing Large Language Models for Multi-property Molecule Optimization
Dey, Vishal
Hu, Xiao
Ning, Xia
Machine Learning
Artificial Intelligence
Computation and Language
Chemical Physics
Quantitative Methods
Despite recent advancements, most computational methods for molecule optimization are constrained to single- or double-property optimization tasks and suffer from poor scalability and generalizability to novel optimization tasks. Meanwhile, Large Language Models (LLMs) demonstrate remarkable out-of-domain generalizability to novel tasks. To demonstrate LLMs' potential for molecule optimization, we introduce MuMOInstruct, the first high-quality instruction-tuning dataset specifically focused on complex multi-property molecule optimization tasks. Leveraging MuMOInstruct, we develop GeLLMOs, a series of instruction-tuned LLMs for molecule optimization. Extensive evaluations across 5 in-domain and 5 out-of-domain tasks demonstrate that GeLLMOs consistently outperform state-of-the-art baselines. GeLLMOs also exhibit outstanding zero-shot generalization to unseen tasks, significantly outperforming powerful closed-source LLMs. Such strong generalizability demonstrates the tremendous potential of GeLLMOs as foundational models for molecule optimization, thereby tackling novel optimization tasks without resource-intensive retraining. MuMOInstruct, models, and code are accessible through https://github.com/ninglab/GeLLMO.
title GeLLMO: Generalizing Large Language Models for Multi-property Molecule Optimization
topic Machine Learning
Artificial Intelligence
Computation and Language
Chemical Physics
Quantitative Methods
url https://arxiv.org/abs/2502.13398