VQ-SAD: Vector Quantized Structure Aware Diffusion For Molecule Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Noravesh, Farshad, Haffari, Reza, Soon, Layki, Pal, Arghya
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915971993698304
author Noravesh, Farshad
Haffari, Reza
Soon, Layki
Pal, Arghya
author_facet Noravesh, Farshad
Haffari, Reza
Soon, Layki
Pal, Arghya
contents Many diffusion based molecule generation methods ignore the symbolic information of molecules and represent the atom and bond type as one hot representation. Methods based on Morgan fingerprints produce hash collisions and are hard to embed into a continuous space without information loss and random fingerprints correspond to no valid molecule. To circumvent this issue we use another paradigm and consider atom and bond codes as latent variables of VQ-VAE. We introduce VQ-SAD which first trains a VQ-VAE and uses the frozen pretrained VQ-VAE model and considers the codebooks for both atom and bond types as tokenizers for the downstream diffusion process. VQ-SAD is a neuro-symbolic model that utilizes both symbolic and neural structural information for a diffusion based model with learnable forward process. The large discrete code space provides a more balanced atom and bond types which enhances the denoising process. VQ-VAE slightly outperforms SOTA models for diffusion based molecule generation on QM9 and ZINC250k datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2605_00354
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle VQ-SAD: Vector Quantized Structure Aware Diffusion For Molecule Generation
Noravesh, Farshad
Haffari, Reza
Soon, Layki
Pal, Arghya
Machine Learning
Artificial Intelligence
Many diffusion based molecule generation methods ignore the symbolic information of molecules and represent the atom and bond type as one hot representation. Methods based on Morgan fingerprints produce hash collisions and are hard to embed into a continuous space without information loss and random fingerprints correspond to no valid molecule. To circumvent this issue we use another paradigm and consider atom and bond codes as latent variables of VQ-VAE. We introduce VQ-SAD which first trains a VQ-VAE and uses the frozen pretrained VQ-VAE model and considers the codebooks for both atom and bond types as tokenizers for the downstream diffusion process. VQ-SAD is a neuro-symbolic model that utilizes both symbolic and neural structural information for a diffusion based model with learnable forward process. The large discrete code space provides a more balanced atom and bond types which enhances the denoising process. VQ-VAE slightly outperforms SOTA models for diffusion based molecule generation on QM9 and ZINC250k datasets.
title VQ-SAD: Vector Quantized Structure Aware Diffusion For Molecule Generation
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2605.00354