Cover Image

A Comprehensive Review of Transformer-based language models for Protein Sequence Analysis and Design

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ghosh, Nimisha, Santoni, Daniele, Nawn, Debaleena, Ottaviani, Eleonora, Felici, Giovanni
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Quantitative Methods
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Review on the Applications of Transformer-based language models for Nucleotide Sequence Analysis
by: Ghosh, Nimisha, et al.
Published: (2024)

LAMP-PRo: Label-aware Attention for Multi-label Prediction of DNA- and RNA-binding Proteins using Protein Language Models
by: Ghosh, Nimisha, et al.
Published: (2025)

DeepProtein: Deep Learning Library and Benchmark for Protein Sequence Learning
by: Xie, Jiaqing, et al.
Published: (2024)

Large Language Model is Secretly a Protein Sequence Optimizer
by: Wang, Yinkai, et al.
Published: (2025)

AgentPLM: Agentic Protein Language Models with Reasoning-Augmented Decoding for Protein Sequence Design
by: Rahman, Sahil, et al.
Published: (2026)

XAI-Driven Deep Learning for Protein Sequence Functional Group Classification
by: Chakraborty, Pratik, et al.
Published: (2025)

A Text-guided Protein Design Framework
by: Liu, Shengchao, et al.
Published: (2023)

Limitations of Sequence-Based Protein Representations for Parkinson's Disease Classification: A Leakage-Free Benchmark
by: Núñez-Prado, César Jesús, et al.
Published: (2026)

Property-Isometric Variational Autoencoders for Sequence Modeling and Design
by: Sadeghi, Elham, et al.
Published: (2025)

Elucidating the Design Space of Multimodal Protein Language Models
by: Hsieh, Cheng-Yen, et al.
Published: (2025)

Assay2Mol: large language model-based drug design using BioAssay context
by: Deng, Yifan, et al.
Published: (2025)

HyboWaveNet: Hyperbolic Graph Neural Networks with Multi-Scale Wavelet Transform for Protein-Protein Interaction Prediction
by: Yu, Qingzhi, et al.
Published: (2025)

Annotation-guided Protein Design with Multi-Level Domain Alignment
by: Yuan, Chaohao, et al.
Published: (2024)

Recent advances in deep learning and language models for studying the microbiome
by: Yan, Binghao, et al.
Published: (2024)

Design Proteins Using Large Language Models: Enhancements and Comparative Analyses
by: Zeinalipour, Kamyar, et al.
Published: (2024)

Lightweight MSA Design Advances Protein Folding From Evolutionary Embeddings
by: Cao, Hanqun, et al.
Published: (2025)

Self-Improvement Imitation with Biologically Guided Search for Protein Design Under Oracle Budgets
by: Khanna, Ashima, et al.
Published: (2026)

SFM-Protein: Integrative Co-evolutionary Pre-training for Advanced Protein Sequence Representation
by: He, Liang, et al.
Published: (2024)

General Protein Pretraining or Domain-Specific Designs? Benchmarking Protein Modeling on Realistic Applications
by: Yan, Shuo, et al.
Published: (2025)

xTrimoPGLM: Unified 100B-Scale Pre-trained Transformer for Deciphering the Language of Protein
by: Chen, Bo, et al.
Published: (2024)

Learning to Predict Mutation Effects of Protein-Protein Interactions by Microenvironment-aware Hierarchical Prompt Learning
by: Wu, Lirong, et al.
Published: (2024)

Contextualizing biological perturbation experiments through language
by: Wu, Menghua, et al.
Published: (2025)

Hashing for Protein Structure Similarity Search
by: Han, Jin, et al.
Published: (2024)

Protein Representation Learning with Sequence Information Embedding: Does it Always Lead to a Better Performance?
by: Tan, Yang, et al.
Published: (2024)

Protein Structure Tokenization: Benchmarking and New Recipe
by: Yuan, Xinyu, et al.
Published: (2025)

Training Compute-Optimal Protein Language Models
by: Cheng, Xingyi, et al.
Published: (2024)

Co-Generative De Novo Functional Protein Design
by: Chen, Xinrui, et al.
Published: (2026)

Latent Diffusion Models for Controllable RNA Sequence Generation
by: Huang, Kaixuan, et al.
Published: (2024)

Improving AlphaFlow for Efficient Protein Ensembles Generation
by: Li, Shaoning, et al.
Published: (2024)

PhysioSeq2Seq: A Hybrid Physiological Digital Twin and Sequence-to-Sequence LSTM for Long-Horizon Glucose Forecasting in Type 1 Diabetes
by: Tran, Phat, et al.
Published: (2026)

Protein binding affinity prediction under multiple substitutions applying eGNNs on Residue and Atomic graphs combined with Language model information: eGRAL
by: Fiorellini-Bernardis, Arturo, et al.
Published: (2024)

Pre-trained protein language model for codon optimization
by: Pathak, Shashank, et al.
Published: (2024)

Dynamics-inspired Structure Hallucination for Protein-protein Interaction Modeling
by: Wu, Fang, et al.
Published: (2026)

DCFold: Efficient Protein Structure Generation with Single Forward Pass
by: Zhang, Zhe, et al.
Published: (2026)

Fast and Interpretable Protein Substructure Alignment via Optimal Transport
by: Wang, Zhiyu, et al.
Published: (2025)

Adaptive Multimodal Protein Plug-and-Play with Diffusion-Based Priors
by: Banerjee, Amartya, et al.
Published: (2025)

A Novel Framework for Multi-Modal Protein Representation Learning
by: Zheng, Runjie, et al.
Published: (2025)

Structure-based Drug Design Benchmark: Do 3D Methods Really Dominate?
by: Zheng, Kangyu, et al.
Published: (2024)

PhaGO: Protein function annotation for bacteriophages by integrating the genomic context
by: Guan, Jiaojiao, et al.
Published: (2024)

ProteinBench: A Holistic Evaluation of Protein Foundation Models
by: Ye, Fei, et al.
Published: (2024)