Distributional Priors Guided Diffusion for Generating 3D Molecules in Low Data Regimes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hong, Haokai, Lin, Wanyu, Yang, Ming, Tan, Kay Chen
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910037147910144
author Hong, Haokai
Lin, Wanyu
Yang, Ming
Tan, Kay Chen
author_facet Hong, Haokai
Lin, Wanyu
Yang, Ming
Tan, Kay Chen
contents Can we train a 3D molecule generator using data from dense regions to generate samples in sparse regions? This challenge can be framed as an out-of-distribution (OOD) generation problem. While prior research on OOD generation predominantly targets property shifts, structural shifts -- such as differences in molecular scaffolds or functional groups -- represent an equally critical source of distributional shifts. This work introduces the Geometric OOD Diffusion Model (GODD), a novel diffusion-based framework that enables training on data-abundant molecular distributions while generalizing to data-scarce distributions under distributional structural shifts. Central to our approach is a designated equivariant asymmetric autoencoder to capture distributional structural priors. The asymmetric design allows the model to generalize to unseen structural variations by capturing distributional priors representing distinct distributions. The encoded structural-grained priors guide generation toward sparse regions without requiring explicit training on such data. Evaluated across standard benchmarks encompassing OOD structural shifts (e.g., scaffolds, rings), GODD achieves an improvement of 12.6% in success rate, defined based on molecular validity, uniqueness, and novelty. Furthermore, the framework demonstrates promising performance and generalization on canonical fragment-based drug design tasks, highlighting its utility in learning-based molecular discovery.
format Preprint
id arxiv_https___arxiv_org_abs_2404_00962
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Distributional Priors Guided Diffusion for Generating 3D Molecules in Low Data Regimes
Hong, Haokai
Lin, Wanyu
Yang, Ming
Tan, Kay Chen
Machine Learning
Chemical Physics
Biomolecules
Can we train a 3D molecule generator using data from dense regions to generate samples in sparse regions? This challenge can be framed as an out-of-distribution (OOD) generation problem. While prior research on OOD generation predominantly targets property shifts, structural shifts -- such as differences in molecular scaffolds or functional groups -- represent an equally critical source of distributional shifts. This work introduces the Geometric OOD Diffusion Model (GODD), a novel diffusion-based framework that enables training on data-abundant molecular distributions while generalizing to data-scarce distributions under distributional structural shifts. Central to our approach is a designated equivariant asymmetric autoencoder to capture distributional structural priors. The asymmetric design allows the model to generalize to unseen structural variations by capturing distributional priors representing distinct distributions. The encoded structural-grained priors guide generation toward sparse regions without requiring explicit training on such data. Evaluated across standard benchmarks encompassing OOD structural shifts (e.g., scaffolds, rings), GODD achieves an improvement of 12.6% in success rate, defined based on molecular validity, uniqueness, and novelty. Furthermore, the framework demonstrates promising performance and generalization on canonical fragment-based drug design tasks, highlighting its utility in learning-based molecular discovery.
title Distributional Priors Guided Diffusion for Generating 3D Molecules in Low Data Regimes
topic Machine Learning
Chemical Physics
Biomolecules
url https://arxiv.org/abs/2404.00962