Dual-Modality Representation Learning for Molecular Property Prediction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhao, Anyin, Chen, Zuquan, Fang, Zhengyu, Zhang, Xiaoge, Li, Jing
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909717346910208
author Zhao, Anyin
Chen, Zuquan
Fang, Zhengyu
Zhang, Xiaoge
Li, Jing
author_facet Zhao, Anyin
Chen, Zuquan
Fang, Zhengyu
Zhang, Xiaoge
Li, Jing
contents Molecular property prediction has attracted substantial attention recently. Accurate prediction of drug properties relies heavily on effective molecular representations. The structures of chemical compounds are commonly represented as graphs or SMILES sequences. Recent advances in learning drug properties commonly employ Graph Neural Networks (GNNs) based on the graph representation. For the SMILES representation, Transformer-based architectures have been adopted by treating each SMILES string as a sequence of tokens. Because each representation has its own advantages and disadvantages, combining both representations in learning drug properties is a promising direction. We propose a method named Dual-Modality Cross-Attention (DMCA) that can effectively combine the strengths of two representations by employing the cross-attention mechanism. DMCA was evaluated across eight datasets including both classification and regression tasks. Results show that our method achieves the best overall performance, highlighting its effectiveness in leveraging the complementary information from both graph and SMILES modalities.
format Preprint
id arxiv_https___arxiv_org_abs_2501_06608
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Dual-Modality Representation Learning for Molecular Property Prediction
Zhao, Anyin
Chen, Zuquan
Fang, Zhengyu
Zhang, Xiaoge
Li, Jing
Machine Learning
Quantitative Methods
Molecular property prediction has attracted substantial attention recently. Accurate prediction of drug properties relies heavily on effective molecular representations. The structures of chemical compounds are commonly represented as graphs or SMILES sequences. Recent advances in learning drug properties commonly employ Graph Neural Networks (GNNs) based on the graph representation. For the SMILES representation, Transformer-based architectures have been adopted by treating each SMILES string as a sequence of tokens. Because each representation has its own advantages and disadvantages, combining both representations in learning drug properties is a promising direction. We propose a method named Dual-Modality Cross-Attention (DMCA) that can effectively combine the strengths of two representations by employing the cross-attention mechanism. DMCA was evaluated across eight datasets including both classification and regression tasks. Results show that our method achieves the best overall performance, highlighting its effectiveness in leveraging the complementary information from both graph and SMILES modalities.
title Dual-Modality Representation Learning for Molecular Property Prediction
topic Machine Learning
Quantitative Methods
url https://arxiv.org/abs/2501.06608