Applications of Modular Co-Design for De Novo 3D Molecule Generation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Reidenbach, Danny, Nikitin, Filipp, Isayev, Olexandr, Paliwal, Saee
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915304984018944
author Reidenbach, Danny
Nikitin, Filipp
Isayev, Olexandr
Paliwal, Saee
author_facet Reidenbach, Danny
Nikitin, Filipp
Isayev, Olexandr
Paliwal, Saee
contents De novo 3D molecule generation is a pivotal task in drug discovery. However, many recent geometric generative models struggle to produce high-quality 3D structures, even if they maintain 2D validity and topological stability. To tackle this issue and enhance the learning of effective molecular generation dynamics, we present Megalodon-a family of scalable transformer models. These models are enhanced with basic equivariant layers and trained using a joint continuous and discrete denoising co-design objective. We assess Megalodon's performance on established molecule generation benchmarks and introduce new 3D structure benchmarks that evaluate a model's capability to generate realistic molecular structures, particularly focusing on energetics. We show that Megalodon achieves state-of-the-art results in 3D molecule generation, conditional structure generation, and structure energy benchmarks using diffusion and flow matching. Furthermore, doubling the number of parameters in Megalodon to 40M significantly enhances its performance, generating up to 49x more valid large molecules and achieving energy levels that are 2-10x lower than those of the best prior generative models.
format Preprint
id arxiv_https___arxiv_org_abs_2505_18392
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Applications of Modular Co-Design for De Novo 3D Molecule Generation
Reidenbach, Danny
Nikitin, Filipp
Isayev, Olexandr
Paliwal, Saee
Machine Learning
Artificial Intelligence
Biomolecules
Quantitative Methods
De novo 3D molecule generation is a pivotal task in drug discovery. However, many recent geometric generative models struggle to produce high-quality 3D structures, even if they maintain 2D validity and topological stability. To tackle this issue and enhance the learning of effective molecular generation dynamics, we present Megalodon-a family of scalable transformer models. These models are enhanced with basic equivariant layers and trained using a joint continuous and discrete denoising co-design objective. We assess Megalodon's performance on established molecule generation benchmarks and introduce new 3D structure benchmarks that evaluate a model's capability to generate realistic molecular structures, particularly focusing on energetics. We show that Megalodon achieves state-of-the-art results in 3D molecule generation, conditional structure generation, and structure energy benchmarks using diffusion and flow matching. Furthermore, doubling the number of parameters in Megalodon to 40M significantly enhances its performance, generating up to 49x more valid large molecules and achieving energy levels that are 2-10x lower than those of the best prior generative models.
title Applications of Modular Co-Design for De Novo 3D Molecule Generation
topic Machine Learning
Artificial Intelligence
Biomolecules
Quantitative Methods
url https://arxiv.org/abs/2505.18392