Saved in:
Bibliographic Details
Main Authors: Ahn, Jihun, Irianti, Gabriella Pasya, Thapar, Vikram, Hur, Su-Mi
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2512.06301
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909947191623680
author Ahn, Jihun
Irianti, Gabriella Pasya
Thapar, Vikram
Hur, Su-Mi
author_facet Ahn, Jihun
Irianti, Gabriella Pasya
Thapar, Vikram
Hur, Su-Mi
contents Machine learning has transformed material discovery for inorganic compounds and small molecules, yet polymers remain largely inaccessible to these methods. While data scarcity is often cited as the primary bottleneck, we demonstrate that strategic molecular representations can overcome this limitation. We introduce CI-LLM (Chemically Informed Language Model), a framework combining HAPPY (Hierarchically Abstracted rePeat unit of PolYmer), which encodes chemical substructures as tokens, with numerical descriptors within transformer architectures. For property prediction, De$^3$BERTa, our descriptor-enriched encoder, achieves 3.5x faster inference than SMILES-based models with improved accuracy ($R^2$ score gains of 0.9-4.1 percent across four properties), while providing interpretable structure-property insights at the subgroup level. For inverse design, our GPT-based generator produces polymers with targeted properties, achieving 100 percent scaffold retention and successful multi-property optimization for negatively correlated objectives. This comprehensive framework demonstrates both forward prediction and inverse design capabilities, showcasing how strategic molecular representation advances machine learning applications in polymer science.
format Preprint
id arxiv_https___arxiv_org_abs_2512_06301
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Chemistry Integrated Language Model using Hierarchical Molecular Representation for Polymer Informatics
Ahn, Jihun
Irianti, Gabriella Pasya
Thapar, Vikram
Hur, Su-Mi
Machine Learning
Artificial Intelligence
Machine learning has transformed material discovery for inorganic compounds and small molecules, yet polymers remain largely inaccessible to these methods. While data scarcity is often cited as the primary bottleneck, we demonstrate that strategic molecular representations can overcome this limitation. We introduce CI-LLM (Chemically Informed Language Model), a framework combining HAPPY (Hierarchically Abstracted rePeat unit of PolYmer), which encodes chemical substructures as tokens, with numerical descriptors within transformer architectures. For property prediction, De$^3$BERTa, our descriptor-enriched encoder, achieves 3.5x faster inference than SMILES-based models with improved accuracy ($R^2$ score gains of 0.9-4.1 percent across four properties), while providing interpretable structure-property insights at the subgroup level. For inverse design, our GPT-based generator produces polymers with targeted properties, achieving 100 percent scaffold retention and successful multi-property optimization for negatively correlated objectives. This comprehensive framework demonstrates both forward prediction and inverse design capabilities, showcasing how strategic molecular representation advances machine learning applications in polymer science.
title Chemistry Integrated Language Model using Hierarchical Molecular Representation for Polymer Informatics
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2512.06301