Enhancing Chemical Reaction and Retrosynthesis Prediction with Large Language Model and Dual-task Learning

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Lin, Xuan, Liu, Qingrui, Xiang, Hongxin, Zeng, Daojian, Zeng, Xiangxiang
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913820544335872
author Lin, Xuan
Liu, Qingrui
Xiang, Hongxin
Zeng, Daojian
Zeng, Xiangxiang
author_facet Lin, Xuan
Liu, Qingrui
Xiang, Hongxin
Zeng, Daojian
Zeng, Xiangxiang
contents Chemical reaction and retrosynthesis prediction are fundamental tasks in drug discovery. Recently, large language models (LLMs) have shown potential in many domains. However, directly applying LLMs to these tasks faces two major challenges: (i) lacking a large-scale chemical synthesis-related instruction dataset; (ii) ignoring the close correlation between reaction and retrosynthesis prediction for the existing fine-tuning strategies. To address these challenges, we propose ChemDual, a novel LLM framework for accurate chemical synthesis. Specifically, considering the high cost of data acquisition for reaction and retrosynthesis, ChemDual regards the reaction-and-retrosynthesis of molecules as a related recombination-and-fragmentation process and constructs a large-scale of 4.4 million instruction dataset. Furthermore, ChemDual introduces an enhanced LLaMA, equipped with a multi-scale tokenizer and dual-task learning strategy, to jointly optimize the process of recombination and fragmentation as well as the tasks between reaction and retrosynthesis prediction. Extensive experiments on Mol-Instruction and USPTO-50K datasets demonstrate that ChemDual achieves state-of-the-art performance in both predictions of reaction and retrosynthesis, outperforming the existing conventional single-task approaches and the general open-source LLMs. Through molecular docking analysis, ChemDual generates compounds with diverse and strong protein binding affinity, further highlighting its strong potential in drug design.
format Preprint
id arxiv_https___arxiv_org_abs_2505_02639
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing Chemical Reaction and Retrosynthesis Prediction with Large Language Model and Dual-task Learning
Lin, Xuan
Liu, Qingrui
Xiang, Hongxin
Zeng, Daojian
Zeng, Xiangxiang
Machine Learning
Artificial Intelligence
Computation and Language
Chemical reaction and retrosynthesis prediction are fundamental tasks in drug discovery. Recently, large language models (LLMs) have shown potential in many domains. However, directly applying LLMs to these tasks faces two major challenges: (i) lacking a large-scale chemical synthesis-related instruction dataset; (ii) ignoring the close correlation between reaction and retrosynthesis prediction for the existing fine-tuning strategies. To address these challenges, we propose ChemDual, a novel LLM framework for accurate chemical synthesis. Specifically, considering the high cost of data acquisition for reaction and retrosynthesis, ChemDual regards the reaction-and-retrosynthesis of molecules as a related recombination-and-fragmentation process and constructs a large-scale of 4.4 million instruction dataset. Furthermore, ChemDual introduces an enhanced LLaMA, equipped with a multi-scale tokenizer and dual-task learning strategy, to jointly optimize the process of recombination and fragmentation as well as the tasks between reaction and retrosynthesis prediction. Extensive experiments on Mol-Instruction and USPTO-50K datasets demonstrate that ChemDual achieves state-of-the-art performance in both predictions of reaction and retrosynthesis, outperforming the existing conventional single-task approaches and the general open-source LLMs. Through molecular docking analysis, ChemDual generates compounds with diverse and strong protein binding affinity, further highlighting its strong potential in drug design.
title Enhancing Chemical Reaction and Retrosynthesis Prediction with Large Language Model and Dual-task Learning
topic Machine Learning
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2505.02639