Cover Image

Induction Meets Biology: Mechanisms of Repeat Detection in Protein Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pomerants, Gal, Nikankin, Yaniv, Reusch, Anja, Tsaban, Tomer, Schueler-Furman, Ora, Belinkov, Yonatan
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Biomolecules
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Mechanisms of AI Protein Folding in ESMFold
by: Lu, Kevin, et al.
Published: (2026)

ContactNet: Geometric-Based Deep Learning Model for Predicting Protein-Protein Interactions
by: Halfon, Matan, et al.
Published: (2024)

Steering Protein Language Models
by: Huang, Long-Kai, et al.
Published: (2025)

AlphaFold Meets Flow Matching for Generating Protein Ensembles
by: Jing, Bowen, et al.
Published: (2024)

Structure-Informed Protein Language Model
by: Zhang, Zuobai, et al.
Published: (2024)

Open-Source Protein Language Models for Function Prediction and Protein Design
by: Pandi, Shivasankaran Vanaja, et al.
Published: (2024)

Energy Efficient Protein Language Models: Leveraging Small Language Models with LoRA for Controllable Protein Generation
by: Shah, Aayush, et al.
Published: (2024)

Arithmetic Without Algorithms: Language Models Solve Math With a Bag of Heuristics
by: Nikankin, Yaniv, et al.
Published: (2024)

Peptide Sequencing Via Protein Language Models
by: Pham, Thuong Le Hoai, et al.
Published: (2024)

Structure Language Models for Protein Conformation Generation
by: Lu, Jiarui, et al.
Published: (2024)

Diffusion Language Models Are Versatile Protein Learners
by: Wang, Xinyou, et al.
Published: (2024)

Protein-Mamba: Biological Mamba Models for Protein Function Prediction
by: Xu, Bohao, et al.
Published: (2024)

Interpreting and Steering Protein Language Models through Sparse Autoencoders
by: Garcia, Edith Natalia Villegas, et al.
Published: (2025)

Reverse Distillation: Consistently Scaling Protein Language Model Representations
by: Catrina, Darius, et al.
Published: (2026)

Function-Guided Conditional Generation Using Protein Language Models with Adapters
by: Yang, Jason, et al.
Published: (2024)

Automated Neuron Labelling Enables Generative Steering and Interpretability in Protein Language Models
by: Banerjee, Arjun, et al.
Published: (2025)

Long-context Protein Language Modeling Using Bidirectional Mamba with Shared Projection Layers
by: Wang, Yingheng, et al.
Published: (2024)

Do Protein Transformers Have Biological Intelligence?
by: Lin, Fudong, et al.
Published: (2025)

Steering Generative Models with Experimental Data for Protein Fitness Optimization
by: Yang, Jason, et al.
Published: (2025)

Internal-Coordinate Density Modelling of Protein Structure: Covariance Matters
by: Arts, Marloes, et al.
Published: (2023)

OneProt: Towards Multi-Modal Protein Foundation Models
by: Flöge, Klemens, et al.
Published: (2024)

Insights Into the Inner Workings of Transformer Models for Protein Function Prediction
by: Wenzel, Markus, et al.
Published: (2023)

A Model-Centric Review of Deep Learning for Protein Design
by: Kyro, Gregory W., et al.
Published: (2025)

MAPE-PPI: Towards Effective and Efficient Protein-Protein Interaction Prediction via Microenvironment-Aware Protein Embedding
by: Wu, Lirong, et al.
Published: (2024)

Endowing Protein Language Models with Structural Knowledge
by: Chen, Dexiong, et al.
Published: (2024)

ProteinWeaver: A Divide-and-Assembly Approach for Protein Backbone Design
by: Ma, Yiming, et al.
Published: (2024)

Accelerating Inference in Molecular Diffusion Models with Latent Representations of Protein Structure
by: Dunn, Ian, et al.
Published: (2023)

Adaptive Protein Tokenization
by: Dilip, Rohit, et al.
Published: (2026)

Rigid Protein-Protein Docking via Equivariant Elliptic-Paraboloid Interface Prediction
by: Yu, Ziyang, et al.
Published: (2024)

Beyond ESM2: Graph-Enhanced Protein Sequence Modeling with Efficient Clustering
by: Jiao, Shujian, et al.
Published: (2024)

Protein Conformation Generation via Force-Guided SE(3) Diffusion Models
by: Wang, Yan, et al.
Published: (2024)

Hierarchical Multi-Label Contrastive Learning for Protein-Protein Interaction Prediction Across Organisms
by: Liu, Shiyi, et al.
Published: (2025)

Compact Artificial Neural Network Models for Predicting Protein Residue -- RNA Base Binding
by: Selitskiy, Stanislav
Published: (2025)

Generative Modeling of Full-Atom Protein Conformations using Latent Diffusion on Graph Embeddings
by: Sengar, Aditya, et al.
Published: (2025)

Large-Scale Multi-omic Biosequence Transformers for Modeling Protein-Nucleic Acid Interactions
by: Chen, Sully F., et al.
Published: (2024)

DISPROTBENCH: Uncovering the Functional Limits of Protein Structure Prediction Models in Intrinsically Disordered Regions
by: Zeng, Xinyue, et al.
Published: (2025)

Protriever: End-to-End Differentiable Protein Homology Search for Fitness Prediction
by: Weitzman, Ruben, et al.
Published: (2025)

Beyond Simple Concatenation: Fairly Assessing PLM Architectures for Multi-Chain Protein-Protein Interactions Prediction
by: Alsamkary, Hazem, et al.
Published: (2025)

Reinforcement Learning for Sequence Design Leveraging Protein Language Models
by: Subramanian, Jithendaraa, et al.
Published: (2024)

MutaPLM: Protein Language Modeling for Mutation Explanation and Engineering
by: Luo, Yizhen, et al.
Published: (2024)