A Diffusion Model to Shrink Proteins While Maintaining Their Function

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Baron, Ethan, Amin, Alan N., Weitzman, Ruben, Marks, Debora, Wilson, Andrew Gordon
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917099661688832
author Baron, Ethan
Amin, Alan N.
Weitzman, Ruben
Marks, Debora
Wilson, Andrew Gordon
author_facet Baron, Ethan
Amin, Alan N.
Weitzman, Ruben
Marks, Debora
Wilson, Andrew Gordon
contents Many proteins useful in modern medicine or bioengineering are challenging to make in the lab, fuse with other proteins in cells, or deliver to tissues in the body, because their sequences are too long. Shortening these sequences typically involves costly, time-consuming experimental campaigns. Ideally, we could instead use modern models of massive databases of sequences from nature to learn how to propose shrunken proteins that resemble sequences found in nature. Unfortunately, these models struggle to efficiently search the combinatorial space of all deletions, and are not trained with inductive biases to learn how to delete. To address this gap, we propose SCISOR, a novel discrete diffusion model that deletes letters from sequences to generate protein samples that resemble those found in nature. To do so, SCISOR trains a de-noiser to reverse a forward noising process that adds random insertions to natural sequences. As a generative model, SCISOR fits evolutionary sequence data competitively with previous large models. In evaluation, SCISOR achieves state-of-the-art predictions of the functional effects of deletions on ProteinGym. Finally, we use the SCISOR de-noiser to shrink long protein sequences, and show that its suggested deletions result in significantly more realistic proteins and more often preserve functional motifs than previous models of evolutionary sequences.
format Preprint
id arxiv_https___arxiv_org_abs_2511_07390
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Diffusion Model to Shrink Proteins While Maintaining Their Function
Baron, Ethan
Amin, Alan N.
Weitzman, Ruben
Marks, Debora
Wilson, Andrew Gordon
Machine Learning
Quantitative Methods
Many proteins useful in modern medicine or bioengineering are challenging to make in the lab, fuse with other proteins in cells, or deliver to tissues in the body, because their sequences are too long. Shortening these sequences typically involves costly, time-consuming experimental campaigns. Ideally, we could instead use modern models of massive databases of sequences from nature to learn how to propose shrunken proteins that resemble sequences found in nature. Unfortunately, these models struggle to efficiently search the combinatorial space of all deletions, and are not trained with inductive biases to learn how to delete. To address this gap, we propose SCISOR, a novel discrete diffusion model that deletes letters from sequences to generate protein samples that resemble those found in nature. To do so, SCISOR trains a de-noiser to reverse a forward noising process that adds random insertions to natural sequences. As a generative model, SCISOR fits evolutionary sequence data competitively with previous large models. In evaluation, SCISOR achieves state-of-the-art predictions of the functional effects of deletions on ProteinGym. Finally, we use the SCISOR de-noiser to shrink long protein sequences, and show that its suggested deletions result in significantly more realistic proteins and more often preserve functional motifs than previous models of evolutionary sequences.
title A Diffusion Model to Shrink Proteins While Maintaining Their Function
topic Machine Learning
Quantitative Methods
url https://arxiv.org/abs/2511.07390