Salvato in:
Dettagli Bibliografici
Autori principali: Sawhney, Rajan, Ferrell, Barbra, Dejean, Thibaut, Schreiber, Zachary, Harrigan, William, Polson, Shawn W, Wommack, K Eric, Belcaid, Mahdi
Natura: Artículo científico
Lingua:en
Pubblicazione: bioRxiv : the preprint server for biology 2025
Accesso online:https://pubmed.ncbi.nlm.nih.gov/40661509/
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1868266179208937473
author Sawhney, Rajan
Ferrell, Barbra
Dejean, Thibaut
Schreiber, Zachary
Harrigan, William
Polson, Shawn W
Wommack, K Eric
Belcaid, Mahdi
author_facet Sawhney, Rajan
Ferrell, Barbra
Dejean, Thibaut
Schreiber, Zachary
Harrigan, William
Polson, Shawn W
Wommack, K Eric
Belcaid, Mahdi
Sawhney, Rajan
Ferrell, Barbra
Dejean, Thibaut
Schreiber, Zachary
Harrigan, William
Polson, Shawn W
Wommack, K Eric
Belcaid, Mahdi
collection PubMed - marine biology
contents Fine-Tuning Protein Language Models Unlocks the Potential of Underrepresented Viral Proteomes. Sawhney, Rajan Ferrell, Barbra Dejean, Thibaut Schreiber, Zachary Harrigan, William Polson, Shawn W Wommack, K Eric Belcaid, Mahdi Protein language models (pLMs) have revolutionized computational biology by generating rich protein vector representations-or embeddings-enabling major advancements in de novo protein design, structure prediction, variant effect analysis, and evolutionary studies. Despite these breakthroughs, current pLMs often exhibit biases against proteins from underrepresented species, with viral proteins being particularly affected-frequently referred to as the "dark matter" of the biological world due to their vast diversity and ubiquity, yet sparse representation in training datasets. Here, we show that fine-tuning pre-trained pLMs on viral protein sequences, using diverse learning frameworks and parameter-efficient strategies, significantly enhances representation quality and improves performance on downstream tasks. To support further research, we provide source code for fine-tuning pLMs and benchmarking embedding quality. By enabling more accurate modeling of viral proteins, our approach advances tools for understanding viral biology, combating emerging infectious diseases, and driving biotechnological innovation.
format Artículo científico
id pubmed_40661509
institution PubMed
language en
publishDate 2025
publisher bioRxiv : the preprint server for biology
record_format pubmed
spellingShingle Fine-Tuning Protein Language Models Unlocks the Potential of Underrepresented Viral Proteomes.
Sawhney, Rajan
Ferrell, Barbra
Dejean, Thibaut
Schreiber, Zachary
Harrigan, William
Polson, Shawn W
Wommack, K Eric
Belcaid, Mahdi
Fine-Tuning Protein Language Models Unlocks the Potential of Underrepresented Viral Proteomes. Sawhney, Rajan Ferrell, Barbra Dejean, Thibaut Schreiber, Zachary Harrigan, William Polson, Shawn W Wommack, K Eric Belcaid, Mahdi Protein language models (pLMs) have revolutionized computational biology by generating rich protein vector representations-or embeddings-enabling major advancements in de novo protein design, structure prediction, variant effect analysis, and evolutionary studies. Despite these breakthroughs, current pLMs often exhibit biases against proteins from underrepresented species, with viral proteins being particularly affected-frequently referred to as the "dark matter" of the biological world due to their vast diversity and ubiquity, yet sparse representation in training datasets. Here, we show that fine-tuning pre-trained pLMs on viral protein sequences, using diverse learning frameworks and parameter-efficient strategies, significantly enhances representation quality and improves performance on downstream tasks. To support further research, we provide source code for fine-tuning pLMs and benchmarking embedding quality. By enabling more accurate modeling of viral proteins, our approach advances tools for understanding viral biology, combating emerging infectious diseases, and driving biotechnological innovation.
title Fine-Tuning Protein Language Models Unlocks the Potential of Underrepresented Viral Proteomes.
url https://pubmed.ncbi.nlm.nih.gov/40661509/