MolSpectra: Pre-training 3D Molecular Representation with Multi-modal Energy Spectra

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Liang, Liu, Shaozhen, Rong, Yu, Zhao, Deli, Liu, Qiang, Wu, Shu
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913708139085824
author Wang, Liang
Liu, Shaozhen
Rong, Yu
Zhao, Deli
Liu, Qiang
Wu, Shu
Wang, Liang
author_facet Wang, Liang
Liu, Shaozhen
Rong, Yu
Zhao, Deli
Liu, Qiang
Wu, Shu
Wang, Liang
contents Establishing the relationship between 3D structures and the energy states of molecular systems has proven to be a promising approach for learning 3D molecular representations. However, existing methods are limited to modeling the molecular energy states from classical mechanics. This limitation results in a significant oversight of quantum mechanical effects, such as quantized (discrete) energy level structures, which offer a more accurate estimation of molecular energy and can be experimentally measured through energy spectra. In this paper, we propose to utilize the energy spectra to enhance the pre-training of 3D molecular representations (MolSpectra), thereby infusing the knowledge of quantum mechanics into the molecular representations. Specifically, we propose SpecFormer, a multi-spectrum encoder for encoding molecular spectra via masked patch reconstruction. By further aligning outputs from the 3D encoder and spectrum encoder using a contrastive objective, we enhance the 3D encoder's understanding of molecules. Evaluations on public benchmarks reveal that our pre-trained representations surpass existing methods in predicting molecular properties and modeling dynamics.
format Preprint
id arxiv_https___arxiv_org_abs_2502_16284
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MolSpectra: Pre-training 3D Molecular Representation with Multi-modal Energy Spectra
Wang, Liang
Liu, Shaozhen
Rong, Yu
Zhao, Deli
Liu, Qiang
Wu, Shu
Wang, Liang
Machine Learning
Artificial Intelligence
Computational Engineering, Finance, and Science
Chemical Physics
Establishing the relationship between 3D structures and the energy states of molecular systems has proven to be a promising approach for learning 3D molecular representations. However, existing methods are limited to modeling the molecular energy states from classical mechanics. This limitation results in a significant oversight of quantum mechanical effects, such as quantized (discrete) energy level structures, which offer a more accurate estimation of molecular energy and can be experimentally measured through energy spectra. In this paper, we propose to utilize the energy spectra to enhance the pre-training of 3D molecular representations (MolSpectra), thereby infusing the knowledge of quantum mechanics into the molecular representations. Specifically, we propose SpecFormer, a multi-spectrum encoder for encoding molecular spectra via masked patch reconstruction. By further aligning outputs from the 3D encoder and spectrum encoder using a contrastive objective, we enhance the 3D encoder's understanding of molecules. Evaluations on public benchmarks reveal that our pre-trained representations surpass existing methods in predicting molecular properties and modeling dynamics.
title MolSpectra: Pre-training 3D Molecular Representation with Multi-modal Energy Spectra
topic Machine Learning
Artificial Intelligence
Computational Engineering, Finance, and Science
Chemical Physics
url https://arxiv.org/abs/2502.16284