MOL-Mamba: Enhancing Molecular Representation with Structural & Electronic Insights

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hu, Jingjing, Guo, Dan, Si, Zhan, Liu, Deguang, Diao, Yunfeng, Zhang, Jing, Zhou, Jinxing, Wang, Meng
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913680825778176
author Hu, Jingjing
Guo, Dan
Si, Zhan
Liu, Deguang
Diao, Yunfeng
Zhang, Jing
Zhou, Jinxing
Wang, Meng
author_facet Hu, Jingjing
Guo, Dan
Si, Zhan
Liu, Deguang
Diao, Yunfeng
Zhang, Jing
Zhou, Jinxing
Wang, Meng
contents Molecular representation learning plays a crucial role in various downstream tasks, such as molecular property prediction and drug design. To accurately represent molecules, Graph Neural Networks (GNNs) and Graph Transformers (GTs) have shown potential in the realm of self-supervised pretraining. However, existing approaches often overlook the relationship between molecular structure and electronic information, as well as the internal semantic reasoning within molecules. This omission of fundamental chemical knowledge in graph semantics leads to incomplete molecular representations, missing the integration of structural and electronic data. To address these issues, we introduce MOL-Mamba, a framework that enhances molecular representation by combining structural and electronic insights. MOL-Mamba consists of an Atom & Fragment Mamba-Graph (MG) for hierarchical structural reasoning and a Mamba-Transformer (MT) fuser for integrating molecular structure and electronic correlation learning. Additionally, we propose a Structural Distribution Collaborative Training and E-semantic Fusion Training framework to further enhance molecular representation learning. Extensive experiments demonstrate that MOL-Mamba outperforms state-of-the-art baselines across eleven chemical-biological molecular datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2412_16483
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MOL-Mamba: Enhancing Molecular Representation with Structural & Electronic Insights
Hu, Jingjing
Guo, Dan
Si, Zhan
Liu, Deguang
Diao, Yunfeng
Zhang, Jing
Zhou, Jinxing
Wang, Meng
Machine Learning
Chemical Physics
Biomolecules
Molecular representation learning plays a crucial role in various downstream tasks, such as molecular property prediction and drug design. To accurately represent molecules, Graph Neural Networks (GNNs) and Graph Transformers (GTs) have shown potential in the realm of self-supervised pretraining. However, existing approaches often overlook the relationship between molecular structure and electronic information, as well as the internal semantic reasoning within molecules. This omission of fundamental chemical knowledge in graph semantics leads to incomplete molecular representations, missing the integration of structural and electronic data. To address these issues, we introduce MOL-Mamba, a framework that enhances molecular representation by combining structural and electronic insights. MOL-Mamba consists of an Atom & Fragment Mamba-Graph (MG) for hierarchical structural reasoning and a Mamba-Transformer (MT) fuser for integrating molecular structure and electronic correlation learning. Additionally, we propose a Structural Distribution Collaborative Training and E-semantic Fusion Training framework to further enhance molecular representation learning. Extensive experiments demonstrate that MOL-Mamba outperforms state-of-the-art baselines across eleven chemical-biological molecular datasets.
title MOL-Mamba: Enhancing Molecular Representation with Structural & Electronic Insights
topic Machine Learning
Chemical Physics
Biomolecules
url https://arxiv.org/abs/2412.16483