Atom-anchored LLMs speak Chemistry: A Retrosynthesis Demonstration

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hassen, Alan Kai, Bernatavicius, Andrius, Janssen, Antonius P. A., Preuss, Mike, van Westen, Gerard J. P., Clevert, Djork-Arné
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911703817519104
author Hassen, Alan Kai
Bernatavicius, Andrius
Janssen, Antonius P. A.
Preuss, Mike
van Westen, Gerard J. P.
Clevert, Djork-Arné
author_facet Hassen, Alan Kai
Bernatavicius, Andrius
Janssen, Antonius P. A.
Preuss, Mike
van Westen, Gerard J. P.
Clevert, Djork-Arné
contents Applications of machine learning in chemistry are often limited by the scarcity and expense of labeled data, restricting traditional supervised methods. In this work, we introduce a framework for molecular reasoning using general-purpose Large Language Models (LLMs) that operates without requiring task-specific model training. Our method anchors chain-of-thought reasoning to the molecular structure by using unique atomic identifiers. First, the LLM performs a zero-shot task to identify relevant fragments and their associated chemical labels or transformation classes. In an optional second step, this position-aware information is used in a few-shot task with provided class examples to predict the chemical transformation. We apply our framework to single-step retrosynthesis, a task where LLMs have previously underperformed. Across academic benchmarks and expert-validated drug discovery molecules, our work enables LLMs to achieve high success rates in identifying chemically plausible reaction sites ($\geq90\%$), named reaction classes ($\geq40\%$), and final reactants ($\geq74\%$). Ultimately, our work establishes a general blueprint for applying LLMs to challenges where molecular reasoning and molecular transformations are key, positioning atom-anchored LLMs as a powerful solution for data-scarce chemistry domains.
format Preprint
id arxiv_https___arxiv_org_abs_2510_16590
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Atom-anchored LLMs speak Chemistry: A Retrosynthesis Demonstration
Hassen, Alan Kai
Bernatavicius, Andrius
Janssen, Antonius P. A.
Preuss, Mike
van Westen, Gerard J. P.
Clevert, Djork-Arné
Machine Learning
Artificial Intelligence
Biomolecules
Applications of machine learning in chemistry are often limited by the scarcity and expense of labeled data, restricting traditional supervised methods. In this work, we introduce a framework for molecular reasoning using general-purpose Large Language Models (LLMs) that operates without requiring task-specific model training. Our method anchors chain-of-thought reasoning to the molecular structure by using unique atomic identifiers. First, the LLM performs a zero-shot task to identify relevant fragments and their associated chemical labels or transformation classes. In an optional second step, this position-aware information is used in a few-shot task with provided class examples to predict the chemical transformation. We apply our framework to single-step retrosynthesis, a task where LLMs have previously underperformed. Across academic benchmarks and expert-validated drug discovery molecules, our work enables LLMs to achieve high success rates in identifying chemically plausible reaction sites ($\geq90\%$), named reaction classes ($\geq40\%$), and final reactants ($\geq74\%$). Ultimately, our work establishes a general blueprint for applying LLMs to challenges where molecular reasoning and molecular transformations are key, positioning atom-anchored LLMs as a powerful solution for data-scarce chemistry domains.
title Atom-anchored LLMs speak Chemistry: A Retrosynthesis Demonstration
topic Machine Learning
Artificial Intelligence
Biomolecules
url https://arxiv.org/abs/2510.16590