ChemBART: A Pre-trained BART Model Assisting Organic Chemistry Analysis

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Kenan, Zhang, Yijian, Wang, Jin, Gan, Haipeng, Sun, Zeying, Lei, Xiaoguang, Dong, Hao
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918273895890944
author Li, Kenan
Zhang, Yijian
Wang, Jin
Gan, Haipeng
Sun, Zeying
Lei, Xiaoguang
Dong, Hao
author_facet Li, Kenan
Zhang, Yijian
Wang, Jin
Gan, Haipeng
Sun, Zeying
Lei, Xiaoguang
Dong, Hao
contents Recent advances in large language models (LLMs) have demonstrated transformative potential across diverse fields. While LLMs have been applied to molecular simplified molecular input line entry system (SMILES) in computer-aided synthesis planning (CASP), existing methodologies typically address single tasks, such as precursor prediction. We introduce ChemBART, a SMILES-based LLM pre-trained on chemical reactions, which enables a unified model for multiple downstream chemical tasks--achieving the paradigm of "one model, one pre-training, multiple tasks." By leveraging outputs from a mask-filling pre-training task on reaction expressions, ChemBART effectively solves a variety of chemical problems, including precursor/reagent generation, temperature-yield regression, molecular property classification, and optimizing the policy and value functions within a reinforcement learning framework, integrated with Monte Carlo tree search for multi-step synthesis route design. Unlike single-molecule pre-trained LLMs constrained to specific applications, ChemBART addresses broader chemical challenges and integrates them for comprehensive synthesis planning. Crucially, ChemBART-designed multi-step synthesis routes and reaction conditions directly inspired wet-lab validation, which confirmed shorter pathways with ~30% yield improvement over literature benchmarks. Our work validates the power of reaction-focused pre-training and showcases the broad utility of ChemBART in advancing the complete synthesis planning cycle.
format Preprint
id arxiv_https___arxiv_org_abs_2601_02915
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ChemBART: A Pre-trained BART Model Assisting Organic Chemistry Analysis
Li, Kenan
Zhang, Yijian
Wang, Jin
Gan, Haipeng
Sun, Zeying
Lei, Xiaoguang
Dong, Hao
Machine Learning
Recent advances in large language models (LLMs) have demonstrated transformative potential across diverse fields. While LLMs have been applied to molecular simplified molecular input line entry system (SMILES) in computer-aided synthesis planning (CASP), existing methodologies typically address single tasks, such as precursor prediction. We introduce ChemBART, a SMILES-based LLM pre-trained on chemical reactions, which enables a unified model for multiple downstream chemical tasks--achieving the paradigm of "one model, one pre-training, multiple tasks." By leveraging outputs from a mask-filling pre-training task on reaction expressions, ChemBART effectively solves a variety of chemical problems, including precursor/reagent generation, temperature-yield regression, molecular property classification, and optimizing the policy and value functions within a reinforcement learning framework, integrated with Monte Carlo tree search for multi-step synthesis route design. Unlike single-molecule pre-trained LLMs constrained to specific applications, ChemBART addresses broader chemical challenges and integrates them for comprehensive synthesis planning. Crucially, ChemBART-designed multi-step synthesis routes and reaction conditions directly inspired wet-lab validation, which confirmed shorter pathways with ~30% yield improvement over literature benchmarks. Our work validates the power of reaction-focused pre-training and showcases the broad utility of ChemBART in advancing the complete synthesis planning cycle.
title ChemBART: A Pre-trained BART Model Assisting Organic Chemistry Analysis
topic Machine Learning
url https://arxiv.org/abs/2601.02915