A framework for conditional diffusion modelling with applications in motif scaffolding for protein design

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Didi, Kieran, Vargas, Francisco, Mathis, Simon V, Dutordoir, Vincent, Mathieu, Emile, Komorowska, Urszula J, Lio, Pietro
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911797121908736
author Didi, Kieran
Vargas, Francisco
Mathis, Simon V
Dutordoir, Vincent
Mathieu, Emile
Komorowska, Urszula J
Lio, Pietro
author_facet Didi, Kieran
Vargas, Francisco
Mathis, Simon V
Dutordoir, Vincent
Mathieu, Emile
Komorowska, Urszula J
Lio, Pietro
contents Many protein design applications, such as binder or enzyme design, require scaffolding a structural motif with high precision. Generative modelling paradigms based on denoising diffusion processes emerged as a leading candidate to address this motif scaffolding problem and have shown early experimental success in some cases. In the diffusion paradigm, motif scaffolding is treated as a conditional generation task, and several conditional generation protocols were proposed or imported from the Computer Vision literature. However, most of these protocols are motivated heuristically, e.g. via analogies to Langevin dynamics, and lack a unifying framework, obscuring connections between the different approaches. In this work, we unify conditional training and conditional sampling procedures under one common framework based on the mathematically well-understood Doob's h-transform. This new perspective allows us to draw connections between existing methods and propose a new variation on existing conditional training protocols. We illustrate the effectiveness of this new protocol in both, image outpainting and motif scaffolding and find that it outperforms standard methods.
format Preprint
id arxiv_https___arxiv_org_abs_2312_09236
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A framework for conditional diffusion modelling with applications in motif scaffolding for protein design
Didi, Kieran
Vargas, Francisco
Mathis, Simon V
Dutordoir, Vincent
Mathieu, Emile
Komorowska, Urszula J
Lio, Pietro
Machine Learning
Biomolecules
Many protein design applications, such as binder or enzyme design, require scaffolding a structural motif with high precision. Generative modelling paradigms based on denoising diffusion processes emerged as a leading candidate to address this motif scaffolding problem and have shown early experimental success in some cases. In the diffusion paradigm, motif scaffolding is treated as a conditional generation task, and several conditional generation protocols were proposed or imported from the Computer Vision literature. However, most of these protocols are motivated heuristically, e.g. via analogies to Langevin dynamics, and lack a unifying framework, obscuring connections between the different approaches. In this work, we unify conditional training and conditional sampling procedures under one common framework based on the mathematically well-understood Doob's h-transform. This new perspective allows us to draw connections between existing methods and propose a new variation on existing conditional training protocols. We illustrate the effectiveness of this new protocol in both, image outpainting and motif scaffolding and find that it outperforms standard methods.
title A framework for conditional diffusion modelling with applications in motif scaffolding for protein design
topic Machine Learning
Biomolecules
url https://arxiv.org/abs/2312.09236