Cover Image

Towards Understanding the Shape of Representations in Protein Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Beshkov, Kosio, Malthe-Sørenssen, Anders
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Quotient Homology Theory of Representation in Neural Networks
by: Beshkov, Kosio
Published: (2025)

A rank decomposition for the topological classification of neural representations
by: Beshkov, Kosio, et al.
Published: (2024)

Tailoring Frictional Properties of Surfaces Using Diffusion Models
by: Nordhagen, Even Marius, et al.
Published: (2024)

Percolation Theory Using Python
by: Malthe-Sørenssen, Anders
Published: (2024)

Towards Understanding Distilled Reasoning Models: A Representational Approach
by: Baek, David D., et al.
Published: (2025)

Reverse Distillation: Consistently Scaling Protein Language Model Representations
by: Catrina, Darius, et al.
Published: (2026)

Understanding Subword Compositionality of Large Language Models
by: Peng, Qiwei, et al.
Published: (2025)

Towards Understanding the Benefit of Multitask Representation Learning in Decision Process
by: Lu, Rui, et al.
Published: (2025)

What Do GNNs Actually Learn? Towards Understanding their Representations
by: Nikolentzos, Giannis, et al.
Published: (2023)

Towards Understanding Valuable Preference Data for Large Language Model Alignment
by: Zhang, Zizhuo, et al.
Published: (2025)

Structural Interpretations of Protein Language Model Representations via Differentiable Graph Partitioning
by: Dutta, Siddhant, et al.
Published: (2026)

EvoLlama: Enhancing LLMs' Understanding of Proteins via Multimodal Structure and Sequence Representations
by: Liu, Nuowei, et al.
Published: (2024)

Steering Protein Language Models
by: Huang, Long-Kai, et al.
Published: (2025)

Can Large Language Models Understand Intermediate Representations in Compilers?
by: Jiang, Hailong, et al.
Published: (2025)

Towards Understanding How Transformers Learn In-context Through a Representation Learning Lens
by: Ren, Ruifeng, et al.
Published: (2023)

The Signed Two-Space Proximity Model for Learning Representations in Protein-Protein Interaction Networks
by: Nakis, Nikolaos, et al.
Published: (2025)

Diffusion Model with Representation Alignment for Protein Inverse Folding
by: Wang, Chenglin, et al.
Published: (2024)

The Terminal Representation in Reinforcement Learning
by: Esterhuysen, Amir, et al.
Published: (2026)

Aligning Large Language Models and Geometric Deep Models for Protein Representation
by: Shu, Dong, et al.
Published: (2024)

Exploring Biologically Inspired Mechanisms of Adversarial Robustness
by: Holzhausen, Konstantin, et al.
Published: (2024)

Towards Understanding What Code Language Models Learned
by: Ahmed, Toufique, et al.
Published: (2023)

Structure-Informed Protein Language Model
by: Zhang, Zuobai, et al.
Published: (2024)

Open-Source Protein Language Models for Function Prediction and Protein Design
by: Pandi, Shivasankaran Vanaja, et al.
Published: (2024)

No Generation without Representation: Efficient Causal Protein Language Models Enable Zero-Shot Fitness Estimation
by: Eris, Furkan
Published: (2026)

Energy Efficient Protein Language Models: Leveraging Small Language Models with LoRA for Controllable Protein Generation
by: Shah, Aayush, et al.
Published: (2024)

Towards Understanding Sycophancy in Language Models
by: Sharma, Mrinank, et al.
Published: (2023)

Structure-Aware Masking for Protein Representation Learning
by: Walton, Thomas, et al.
Published: (2026)

Factual Consistency of Multilingual Pretrained Language Models
by: Fierro, Constanza, et al.
Published: (2022)

PRISM: A 3D Probabilistic Neural Representation for Interpretable Shape Modeling
by: Jiao, Yining, et al.
Published: (2026)

Accelerating Inference in Molecular Diffusion Models with Latent Representations of Protein Structure
by: Dunn, Ian, et al.
Published: (2023)

Learning to Solve PDEs on Neural Shape Representations
by: Welschinger, Lilian, et al.
Published: (2025)

How Data Augmentation Shapes Neural Representations
by: He, Tianxiao, et al.
Published: (2026)

Metalic: Meta-Learning In-Context with Protein Language Models
by: Beck, Jacob, et al.
Published: (2024)

Preliminary Use of Vision Language Model Driven Extraction of Mouse Behavior Towards Understanding Fear Expression
by: Goulart, Paimon, et al.
Published: (2025)

Information Shapes Koopman Representation
by: Cheng, Xiaoyuan, et al.
Published: (2025)

Towards a Mechanistic Understanding of Propositional Logical Reasoning in Large Language Models
by: Chen, Danchun, et al.
Published: (2026)

Large Language Model-Enhanced Algorithm Selection: Towards Comprehensive Algorithm Representation
by: Wu, Xingyu, et al.
Published: (2023)

Peptide Sequencing Via Protein Language Models
by: Pham, Thuong Le Hoai, et al.
Published: (2024)

Structure Language Models for Protein Conformation Generation
by: Lu, Jiarui, et al.
Published: (2024)

Diffusion Language Models Are Versatile Protein Learners
by: Wang, Xinyou, et al.
Published: (2024)