Protein-Mamba: Biological Mamba Models for Protein Function Prediction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Xu, Bohao, Lu, Yingzhou, Inoue, Yoshitaka, Lee, Namkyeong, Fu, Tianfan, Chen, Jintai
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929509828132864
author Xu, Bohao
Lu, Yingzhou
Inoue, Yoshitaka
Lee, Namkyeong
Fu, Tianfan
Chen, Jintai
author_facet Xu, Bohao
Lu, Yingzhou
Inoue, Yoshitaka
Lee, Namkyeong
Fu, Tianfan
Chen, Jintai
contents Protein function prediction is a pivotal task in drug discovery, significantly impacting the development of effective and safe therapeutics. Traditional machine learning models often struggle with the complexity and variability inherent in predicting protein functions, necessitating more sophisticated approaches. In this work, we introduce Protein-Mamba, a novel two-stage model that leverages both self-supervised learning and fine-tuning to improve protein function prediction. The pre-training stage allows the model to capture general chemical structures and relationships from large, unlabeled datasets, while the fine-tuning stage refines these insights using specific labeled datasets, resulting in superior prediction performance. Our extensive experiments demonstrate that Protein-Mamba achieves competitive performance, compared with a couple of state-of-the-art methods across a range of protein function datasets. This model's ability to effectively utilize both unlabeled and labeled data highlights the potential of self-supervised learning in advancing protein function prediction and offers a promising direction for future research in drug discovery.
format Preprint
id arxiv_https___arxiv_org_abs_2409_14617
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Protein-Mamba: Biological Mamba Models for Protein Function Prediction
Xu, Bohao
Lu, Yingzhou
Inoue, Yoshitaka
Lee, Namkyeong
Fu, Tianfan
Chen, Jintai
Machine Learning
Biomolecules
Quantitative Methods
Protein function prediction is a pivotal task in drug discovery, significantly impacting the development of effective and safe therapeutics. Traditional machine learning models often struggle with the complexity and variability inherent in predicting protein functions, necessitating more sophisticated approaches. In this work, we introduce Protein-Mamba, a novel two-stage model that leverages both self-supervised learning and fine-tuning to improve protein function prediction. The pre-training stage allows the model to capture general chemical structures and relationships from large, unlabeled datasets, while the fine-tuning stage refines these insights using specific labeled datasets, resulting in superior prediction performance. Our extensive experiments demonstrate that Protein-Mamba achieves competitive performance, compared with a couple of state-of-the-art methods across a range of protein function datasets. This model's ability to effectively utilize both unlabeled and labeled data highlights the potential of self-supervised learning in advancing protein function prediction and offers a promising direction for future research in drug discovery.
title Protein-Mamba: Biological Mamba Models for Protein Function Prediction
topic Machine Learning
Biomolecules
Quantitative Methods
url https://arxiv.org/abs/2409.14617