Open-Source Protein Language Models for Function Prediction and Protein Design

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pandi, Shivasankaran Vanaja, Ramsundar, Bharath
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915069459169280
author Pandi, Shivasankaran Vanaja
Ramsundar, Bharath
author_facet Pandi, Shivasankaran Vanaja
Ramsundar, Bharath
contents Protein language models (PLMs) have shown promise in improving the understanding of protein sequences, contributing to advances in areas such as function prediction and protein engineering. However, training these models from scratch requires significant computational resources, limiting their accessibility. To address this, we integrate a PLM into DeepChem, an open-source framework for computational biology and chemistry, to provide a more accessible platform for protein-related tasks. We evaluate the performance of the integrated model on various protein prediction tasks, showing that it achieves reasonable results across benchmarks. Additionally, we present an exploration of generating plastic-degrading enzyme candidates using the model's embeddings and latent space manipulation techniques. While the results suggest that further refinement is needed, this approach provides a foundation for future work in enzyme design. This study aims to facilitate the use of PLMs in research fields like synthetic biology and environmental sustainability, even for those with limited computational resources.
format Preprint
id arxiv_https___arxiv_org_abs_2412_13519
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Open-Source Protein Language Models for Function Prediction and Protein Design
Pandi, Shivasankaran Vanaja
Ramsundar, Bharath
Machine Learning
Biomolecules
Protein language models (PLMs) have shown promise in improving the understanding of protein sequences, contributing to advances in areas such as function prediction and protein engineering. However, training these models from scratch requires significant computational resources, limiting their accessibility. To address this, we integrate a PLM into DeepChem, an open-source framework for computational biology and chemistry, to provide a more accessible platform for protein-related tasks. We evaluate the performance of the integrated model on various protein prediction tasks, showing that it achieves reasonable results across benchmarks. Additionally, we present an exploration of generating plastic-degrading enzyme candidates using the model's embeddings and latent space manipulation techniques. While the results suggest that further refinement is needed, this approach provides a foundation for future work in enzyme design. This study aims to facilitate the use of PLMs in research fields like synthetic biology and environmental sustainability, even for those with limited computational resources.
title Open-Source Protein Language Models for Function Prediction and Protein Design
topic Machine Learning
Biomolecules
url https://arxiv.org/abs/2412.13519