Cover Image

Insights Into the Inner Workings of Transformer Models for Protein Function Prediction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wenzel, Markus, Grüner, Erik, Strodthoff, Nils
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Biomolecules
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Open-Source Protein Language Models for Function Prediction and Protein Design
by: Pandi, Shivasankaran Vanaja, et al.
Published: (2024)

DISPROTBENCH: Uncovering the Functional Limits of Protein Structure Prediction Models in Intrinsically Disordered Regions
by: Zeng, Xinyue, et al.
Published: (2025)

Protein-Mamba: Biological Mamba Models for Protein Function Prediction
by: Xu, Bohao, et al.
Published: (2024)

A Protein Structure Prediction Approach Leveraging Transformer and CNN Integration
by: Zhou, Yanlin, et al.
Published: (2024)

Multiview Random Vector Functional Link Network for Predicting DNA-Binding Proteins
by: Quadir, A., et al.
Published: (2024)

ContactNet: Geometric-Based Deep Learning Model for Predicting Protein-Protein Interactions
by: Halfon, Matan, et al.
Published: (2024)

Multi-modal Representation Learning Enables Accurate Protein Function Prediction in Low-Data Setting
by: Ünsal, Serbülent, et al.
Published: (2024)

Function-Guided Conditional Generation Using Protein Language Models with Adapters
by: Yang, Jason, et al.
Published: (2024)

STAR-GO: Improving Protein Function Prediction by Learning to Hierarchically Integrate Ontology-Informed Semantic Embeddings
by: Akça, Mehmet Efe, et al.
Published: (2025)

Deep Manifold Transformation for Protein Representation Learning
by: Hu, Bozhen, et al.
Published: (2024)

Rigid Protein-Protein Docking via Equivariant Elliptic-Paraboloid Interface Prediction
by: Yu, Ziyang, et al.
Published: (2024)

MAPE-PPI: Towards Effective and Efficient Protein-Protein Interaction Prediction via Microenvironment-Aware Protein Embedding
by: Wu, Lirong, et al.
Published: (2024)

Large-Scale Multi-omic Biosequence Transformers for Modeling Protein-Nucleic Acid Interactions
by: Chen, Sully F., et al.
Published: (2024)

PUFFIN: Protein Unit Discovery with Functional Supervision
by: Uludoğan, Gökçe, et al.
Published: (2026)

Hierarchical Multi-Label Contrastive Learning for Protein-Protein Interaction Prediction Across Organisms
by: Liu, Shiyi, et al.
Published: (2025)

Deep Learning for Protein Complex Prediction and Design
by: Xie, Ziwei
Published: (2026)

Compact Artificial Neural Network Models for Predicting Protein Residue -- RNA Base Binding
by: Selitskiy, Stanislav
Published: (2025)

ETDock: A Novel Equivariant Transformer for Protein-Ligand Docking
by: Yi, Yiqiang, et al.
Published: (2023)

Multi-Scale Representation Learning for Protein Fitness Prediction
by: Zhang, Zuobai, et al.
Published: (2024)

Beyond Simple Concatenation: Fairly Assessing PLM Architectures for Multi-Chain Protein-Protein Interactions Prediction
by: Alsamkary, Hazem, et al.
Published: (2025)

Molecular Fingerprints Are Strong Models for Peptide Function Prediction
by: Adamczyk, Jakub, et al.
Published: (2025)

SurfPro: Functional Protein Design Based on Continuous Surface
by: Song, Zhenqiao, et al.
Published: (2024)

Investigating Graph Neural Networks and Classical Feature-Extraction Techniques in Activity-Cliff and Molecular Property Prediction
by: Dablander, Markus
Published: (2024)

Conformation-Aware Structure Prediction of Antigen-Recognizing Immune Proteins
by: Dreyer, Frédéric A., et al.
Published: (2025)

Efficiently Predicting Mutational Effect on Homologous Proteins by Evolution Encoding
by: Zhong, Zhiqiang, et al.
Published: (2024)

Steering Protein Language Models
by: Huang, Long-Kai, et al.
Published: (2025)

ProtIR: Iterative Refinement between Retrievers and Predictors for Protein Function Annotation
by: Zhang, Zuobai, et al.
Published: (2024)

Learning Protein Structure-Function Relationships through Knowledge-guided Representation Decomposition
by: Wang, Mingqing, et al.
Published: (2026)

Structure-Informed Protein Language Model
by: Zhang, Zuobai, et al.
Published: (2024)

CoPRA: Bridging Cross-domain Pretrained Sequence Models with Complex Structures for Protein-RNA Binding Affinity Prediction
by: Han, Rong, et al.
Published: (2024)

Energy Efficient Protein Language Models: Leveraging Small Language Models with LoRA for Controllable Protein Generation
by: Shah, Aayush, et al.
Published: (2024)

Peptide Sequencing Via Protein Language Models
by: Pham, Thuong Le Hoai, et al.
Published: (2024)

Structure Language Models for Protein Conformation Generation
by: Lu, Jiarui, et al.
Published: (2024)

Diffusion Language Models Are Versatile Protein Learners
by: Wang, Xinyou, et al.
Published: (2024)

ZeroFold: Protein-RNA Binding Affinity Predictions from Pre-Structural Embeddings
by: Hanke, Josef, et al.
Published: (2026)

Few-shot Protein Fitness Prediction via In-context Learning and Test-time Training
by: Teufel, Felix, et al.
Published: (2025)

DecoyDB: A Dataset for Graph Contrastive Learning in Protein-Ligand Binding Affinity Prediction
by: Zhang, Yupu, et al.
Published: (2025)

SIU: A Million-Scale Structural Small Molecule-Protein Interaction Dataset for Unbiased Bioactivity Prediction
by: Huang, Yanwen, et al.
Published: (2024)

Towards Precision Protein-Ligand Affinity Prediction Benchmark: A Complete and Modification-Aware DAVIS Dataset
by: Wu, Ming-Hsiu, et al.
Published: (2025)

Internal-Coordinate Density Modelling of Protein Structure: Covariance Matters
by: Arts, Marloes, et al.
Published: (2023)