Saved in:
Bibliographic Details
Main Authors: Li, Hao, Cao, He, Peng, Shenyao, Liu, Zijing, Feng, Bin, Wang, Yu, Yan, Zhiyuan, Tian, Yonghong, Li, Yu, Yuan, Li
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.17687
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908799627952128
author Li, Hao
Cao, He
Peng, Shenyao
Liu, Zijing
Feng, Bin
Wang, Yu
Yan, Zhiyuan
Tian, Yonghong
Li, Yu
Yuan, Li
author_facet Li, Hao
Cao, He
Peng, Shenyao
Liu, Zijing
Feng, Bin
Wang, Yu
Yan, Zhiyuan
Tian, Yonghong
Li, Yu
Yuan, Li
contents Language models are revolutionizing the biochemistry domain, assisting scientists in drug design and chemical synthesis with high efficiency. Yet current approaches struggle between small language models prone to hallucination and limited knowledge retention, and large cloud-based language models plagued by privacy risks and high inference costs. To bridge this gap, we introduce ChemCRAFT, a novel framework leveraging agentic reinforcement learning to decouple chemical reasoning from knowledge storage. Instead of forcing the model to memorize vast chemical data, our approach empowers the language model to interact with a sandbox for precise information retrieval. This externalization of knowledge allows a locally deployable small model to achieve superior performance with minimal inference costs. To enable small language models for agent-calling ability, we build an agentic trajectory construction pipeline and a comprehensive chemical-agent sandbox. Based on sandbox interactions, we constructed ChemToolDataset, the first large-scale chemical tool trajectory dataset. Simultaneously, we propose SMILES-GRPO to build a dense chemical reward function, promoting the model's ability to call chemical agents. Evaluations across diverse aspects of drug design show that ChemCRAFT outperforms current cloud-based LLMs in molecular structure analysis, molecular optimization, and synthesis pathway prediction, demonstrating that scientific reasoning is not solely an emergent ability of model scale, but a learnable policy of tool orchestration. This work establishes a cost-effective and privacy-preserving paradigm for AI-aided chemistry, opening new avenues for accelerating molecular discovery with locally deployable agents. Code available at https://github.com/HowardLi1984/ChemCraft.
format Preprint
id arxiv_https___arxiv_org_abs_2601_17687
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Agentic reinforcement learning empowers next-generation chemical language models for molecular design and synthesis
Li, Hao
Cao, He
Peng, Shenyao
Liu, Zijing
Feng, Bin
Wang, Yu
Yan, Zhiyuan
Tian, Yonghong
Li, Yu
Yuan, Li
Machine Learning
Artificial Intelligence
Language models are revolutionizing the biochemistry domain, assisting scientists in drug design and chemical synthesis with high efficiency. Yet current approaches struggle between small language models prone to hallucination and limited knowledge retention, and large cloud-based language models plagued by privacy risks and high inference costs. To bridge this gap, we introduce ChemCRAFT, a novel framework leveraging agentic reinforcement learning to decouple chemical reasoning from knowledge storage. Instead of forcing the model to memorize vast chemical data, our approach empowers the language model to interact with a sandbox for precise information retrieval. This externalization of knowledge allows a locally deployable small model to achieve superior performance with minimal inference costs. To enable small language models for agent-calling ability, we build an agentic trajectory construction pipeline and a comprehensive chemical-agent sandbox. Based on sandbox interactions, we constructed ChemToolDataset, the first large-scale chemical tool trajectory dataset. Simultaneously, we propose SMILES-GRPO to build a dense chemical reward function, promoting the model's ability to call chemical agents. Evaluations across diverse aspects of drug design show that ChemCRAFT outperforms current cloud-based LLMs in molecular structure analysis, molecular optimization, and synthesis pathway prediction, demonstrating that scientific reasoning is not solely an emergent ability of model scale, but a learnable policy of tool orchestration. This work establishes a cost-effective and privacy-preserving paradigm for AI-aided chemistry, opening new avenues for accelerating molecular discovery with locally deployable agents. Code available at https://github.com/HowardLi1984/ChemCraft.
title Agentic reinforcement learning empowers next-generation chemical language models for molecular design and synthesis
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2601.17687