Bridge-IF: Learning Inverse Protein Folding with Markov Bridges

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Yiheng, Wu, Jialu, Li, Qiuyi, Yan, Jiahuan, Yin, Mingze, Wu, Wei, Li, Mingyang, Ye, Jieping, Wang, Zheng, Wu, Jian
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916467034816512
author Zhu, Yiheng
Wu, Jialu
Li, Qiuyi
Yan, Jiahuan
Yin, Mingze
Wu, Wei
Li, Mingyang
Ye, Jieping
Wang, Zheng
Wu, Jian
author_facet Zhu, Yiheng
Wu, Jialu
Li, Qiuyi
Yan, Jiahuan
Yin, Mingze
Wu, Wei
Li, Mingyang
Ye, Jieping
Wang, Zheng
Wu, Jian
contents Inverse protein folding is a fundamental task in computational protein design, which aims to design protein sequences that fold into the desired backbone structures. While the development of machine learning algorithms for this task has seen significant success, the prevailing approaches, which predominantly employ a discriminative formulation, frequently encounter the error accumulation issue and often fail to capture the extensive variety of plausible sequences. To fill these gaps, we propose Bridge-IF, a generative diffusion bridge model for inverse folding, which is designed to learn the probabilistic dependency between the distributions of backbone structures and protein sequences. Specifically, we harness an expressive structure encoder to propose a discrete, informative prior derived from structures, and establish a Markov bridge to connect this prior with native sequences. During the inference stage, Bridge-IF progressively refines the prior sequence, culminating in a more plausible design. Moreover, we introduce a reparameterization perspective on Markov bridge models, from which we derive a simplified loss function that facilitates more effective training. We also modulate protein language models (PLMs) with structural conditions to precisely approximate the Markov bridge process, thereby significantly enhancing generation performance while maintaining parameter-efficient training. Extensive experiments on well-established benchmarks demonstrate that Bridge-IF predominantly surpasses existing baselines in sequence recovery and excels in the design of plausible proteins with high foldability. The code is available at https://github.com/violet-sto/Bridge-IF.
format Preprint
id arxiv_https___arxiv_org_abs_2411_02120
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Bridge-IF: Learning Inverse Protein Folding with Markov Bridges
Zhu, Yiheng
Wu, Jialu
Li, Qiuyi
Yan, Jiahuan
Yin, Mingze
Wu, Wei
Li, Mingyang
Ye, Jieping
Wang, Zheng
Wu, Jian
Machine Learning
Artificial Intelligence
Biomolecules
Inverse protein folding is a fundamental task in computational protein design, which aims to design protein sequences that fold into the desired backbone structures. While the development of machine learning algorithms for this task has seen significant success, the prevailing approaches, which predominantly employ a discriminative formulation, frequently encounter the error accumulation issue and often fail to capture the extensive variety of plausible sequences. To fill these gaps, we propose Bridge-IF, a generative diffusion bridge model for inverse folding, which is designed to learn the probabilistic dependency between the distributions of backbone structures and protein sequences. Specifically, we harness an expressive structure encoder to propose a discrete, informative prior derived from structures, and establish a Markov bridge to connect this prior with native sequences. During the inference stage, Bridge-IF progressively refines the prior sequence, culminating in a more plausible design. Moreover, we introduce a reparameterization perspective on Markov bridge models, from which we derive a simplified loss function that facilitates more effective training. We also modulate protein language models (PLMs) with structural conditions to precisely approximate the Markov bridge process, thereby significantly enhancing generation performance while maintaining parameter-efficient training. Extensive experiments on well-established benchmarks demonstrate that Bridge-IF predominantly surpasses existing baselines in sequence recovery and excels in the design of plausible proteins with high foldability. The code is available at https://github.com/violet-sto/Bridge-IF.
title Bridge-IF: Learning Inverse Protein Folding with Markov Bridges
topic Machine Learning
Artificial Intelligence
Biomolecules
url https://arxiv.org/abs/2411.02120