Image de couverture de livre

Reverse Distillation: Consistently Scaling Protein Language Model Representations

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Catrina, Darius, Bepler, Christian, Sledzieski, Samuel, Singh, Rohit
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Biomolecules
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Multi-Scale Representation Learning for Protein Fitness Prediction
par: Zhang, Zuobai, et autres
Publié: (2024)

Adaptive Protein Tokenization
par: Dilip, Rohit, et autres
Publié: (2026)

Flow Autoencoders are Effective Protein Tokenizers
par: Dilip, Rohit, et autres
Publié: (2025)

Steering Protein Language Models
par: Huang, Long-Kai, et autres
Publié: (2025)

Unveiling Scaling Behaviors in Molecular Language Models: Effects of Model Size, Data, and Representation
par: Xu, Dong, et autres
Publié: (2026)

Structure-Informed Protein Language Model
par: Zhang, Zuobai, et autres
Publié: (2024)

Open-Source Protein Language Models for Function Prediction and Protein Design
par: Pandi, Shivasankaran Vanaja, et autres
Publié: (2024)

Energy Efficient Protein Language Models: Leveraging Small Language Models with LoRA for Controllable Protein Generation
par: Shah, Aayush, et autres
Publié: (2024)

Accelerating Inference in Molecular Diffusion Models with Latent Representations of Protein Structure
par: Dunn, Ian, et autres
Publié: (2023)

Peptide Sequencing Via Protein Language Models
par: Pham, Thuong Le Hoai, et autres
Publié: (2024)

Structure Language Models for Protein Conformation Generation
par: Lu, Jiarui, et autres
Publié: (2024)

Diffusion Language Models Are Versatile Protein Learners
par: Wang, Xinyou, et autres
Publié: (2024)

Deep Manifold Transformation for Protein Representation Learning
par: Hu, Bozhen, et autres
Publié: (2024)

AtomSurf : Surface Representation for Learning on Protein Structures
par: Mallet, Vincent, et autres
Publié: (2023)

Interpreting and Steering Protein Language Models through Sparse Autoencoders
par: Garcia, Edith Natalia Villegas, et autres
Publié: (2025)

Large-Scale Multi-omic Biosequence Transformers for Modeling Protein-Nucleic Acid Interactions
par: Chen, Sully F., et autres
Publié: (2024)

Advances in Protein Representation Learning: Methods, Applications, and Future Directions
par: Nguyen, Viet Thanh Duy, et autres
Publié: (2025)

Induction Meets Biology: Mechanisms of Repeat Detection in Protein Language Models
par: Pomerants, Gal, et autres
Publié: (2026)

Function-Guided Conditional Generation Using Protein Language Models with Adapters
par: Yang, Jason, et autres
Publié: (2024)

Structural Interpretations of Protein Language Model Representations via Differentiable Graph Partitioning
par: Dutta, Siddhant, et autres
Publié: (2026)

Automated Neuron Labelling Enables Generative Steering and Interpretability in Protein Language Models
par: Banerjee, Arjun, et autres
Publié: (2025)

Learning Protein Structure-Function Relationships through Knowledge-guided Representation Decomposition
par: Wang, Mingqing, et autres
Publié: (2026)

Docking-Aware Attention: Dynamic Protein Representations through Molecular Context Integration
par: Sicherman, Amitay, et autres
Publié: (2025)

Long-context Protein Language Modeling Using Bidirectional Mamba with Shared Projection Layers
par: Wang, Yingheng, et autres
Publié: (2024)

Multi-modal Representation Learning Enables Accurate Protein Function Prediction in Low-Data Setting
par: Ünsal, Serbülent, et autres
Publié: (2024)

Out of Many, One: Designing and Scaffolding Proteins at the Scale of the Structural Universe with Genie 2
par: Lin, Yeqing, et autres
Publié: (2024)

ContactNet: Geometric-Based Deep Learning Model for Predicting Protein-Protein Interactions
par: Halfon, Matan, et autres
Publié: (2024)

SIU: A Million-Scale Structural Small Molecule-Protein Interaction Dataset for Unbiased Bioactivity Prediction
par: Huang, Yanwen, et autres
Publié: (2024)

Protein Representation Learning by Capturing Protein Sequence-Structure-Function Relationship
par: Ko, Eunji, et autres
Publié: (2024)

GOProteinGNN: Leveraging Protein Knowledge Graphs for Protein Representation Learning
par: Kalifa, Dan, et autres
Publié: (2024)

Steering Generative Models with Experimental Data for Protein Fitness Optimization
par: Yang, Jason, et autres
Publié: (2025)

Internal-Coordinate Density Modelling of Protein Structure: Covariance Matters
par: Arts, Marloes, et autres
Publié: (2023)

OneProt: Towards Multi-Modal Protein Foundation Models
par: Flöge, Klemens, et autres
Publié: (2024)

Insights Into the Inner Workings of Transformer Models for Protein Function Prediction
par: Wenzel, Markus, et autres
Publié: (2023)

A Model-Centric Review of Deep Learning for Protein Design
par: Kyro, Gregory W., et autres
Publié: (2025)

MAPE-PPI: Towards Effective and Efficient Protein-Protein Interaction Prediction via Microenvironment-Aware Protein Embedding
par: Wu, Lirong, et autres
Publié: (2024)

Endowing Protein Language Models with Structural Knowledge
par: Chen, Dexiong, et autres
Publié: (2024)

ProteinWeaver: A Divide-and-Assembly Approach for Protein Backbone Design
par: Ma, Yiming, et autres
Publié: (2024)

Rigid Protein-Protein Docking via Equivariant Elliptic-Paraboloid Interface Prediction
par: Yu, Ziyang, et autres
Publié: (2024)

Beyond ESM2: Graph-Enhanced Protein Sequence Modeling with Efficient Clustering
par: Jiao, Shujian, et autres
Publié: (2024)