Imagen de Portada

Energy Efficient Protein Language Models: Leveraging Small Language Models with LoRA for Controllable Protein Generation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Shah, Aayush, Jayaratnam, Shankar
Formato:	Preprint
Publicado:	2024
Materias:	Biomolecules Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Structure Language Models for Protein Conformation Generation
por: Lu, Jiarui, et al.
Publicado: (2024)

Steering Protein Language Models
por: Huang, Long-Kai, et al.
Publicado: (2025)

Structure-Informed Protein Language Model
por: Zhang, Zuobai, et al.
Publicado: (2024)

Open-Source Protein Language Models for Function Prediction and Protein Design
por: Pandi, Shivasankaran Vanaja, et al.
Publicado: (2024)

Reinforcement Learning for Sequence Design Leveraging Protein Language Models
por: Subramanian, Jithendaraa, et al.
Publicado: (2024)

Peptide Sequencing Via Protein Language Models
por: Pham, Thuong Le Hoai, et al.
Publicado: (2024)

Diffusion Language Models Are Versatile Protein Learners
por: Wang, Xinyou, et al.
Publicado: (2024)

Function-Guided Conditional Generation Using Protein Language Models with Adapters
por: Yang, Jason, et al.
Publicado: (2024)

Automated Neuron Labelling Enables Generative Steering and Interpretability in Protein Language Models
por: Banerjee, Arjun, et al.
Publicado: (2025)

Interpreting and Steering Protein Language Models through Sparse Autoencoders
por: Garcia, Edith Natalia Villegas, et al.
Publicado: (2025)

Reverse Distillation: Consistently Scaling Protein Language Model Representations
por: Catrina, Darius, et al.
Publicado: (2026)

Induction Meets Biology: Mechanisms of Repeat Detection in Protein Language Models
por: Pomerants, Gal, et al.
Publicado: (2026)

Endowing Protein Language Models with Structural Knowledge
por: Chen, Dexiong, et al.
Publicado: (2024)

Long-context Protein Language Modeling Using Bidirectional Mamba with Shared Projection Layers
por: Wang, Yingheng, et al.
Publicado: (2024)

Simple, Efficient and Scalable Structure-aware Adapter Boosts Protein Language Models
por: Tan, Yang, et al.
Publicado: (2024)

MAPE-PPI: Towards Effective and Efficient Protein-Protein Interaction Prediction via Microenvironment-Aware Protein Embedding
por: Wu, Lirong, et al.
Publicado: (2024)

Steering Generative Models with Experimental Data for Protein Fitness Optimization
por: Yang, Jason, et al.
Publicado: (2025)

ContactNet: Geometric-Based Deep Learning Model for Predicting Protein-Protein Interactions
por: Halfon, Matan, et al.
Publicado: (2024)

Beyond ESM2: Graph-Enhanced Protein Sequence Modeling with Efficient Clustering
por: Jiao, Shujian, et al.
Publicado: (2024)

MutaPLM: Protein Language Modeling for Mutation Explanation and Engineering
por: Luo, Yizhen, et al.
Publicado: (2024)

On Recovering Higher-order Interactions from Protein Language Models
por: Tsui, Darin, et al.
Publicado: (2024)

A Protein Structure Prediction Approach Leveraging Transformer and CNN Integration
por: Zhou, Yanlin, et al.
Publicado: (2024)

ProtFlow: Fast Protein Sequence Design via Flow Matching on Compressed Protein Language Model Embeddings
por: Kong, Zitai, et al.
Publicado: (2025)

Generative Model for Small Molecules with Latent Space RL Fine-Tuning to Protein Targets
por: Sob, Ulrich A. Mbou, et al.
Publicado: (2024)

GOProteinGNN: Leveraging Protein Knowledge Graphs for Protein Representation Learning
por: Kalifa, Dan, et al.
Publicado: (2024)

Protein Conformation Generation via Force-Guided SE(3) Diffusion Models
por: Wang, Yan, et al.
Publicado: (2024)

Prot42: a Novel Family of Protein Language Models for Target-aware Protein Binder Generation
por: Sayeed, Mohammad Amaan, et al.
Publicado: (2025)

Generative Modeling of Full-Atom Protein Conformations using Latent Diffusion on Graph Embeddings
por: Sengar, Aditya, et al.
Publicado: (2025)

Protein as a Second Language for LLMs
por: Chen, Xinhui, et al.
Publicado: (2025)

Structural Interpretations of Protein Language Model Representations via Differentiable Graph Partitioning
por: Dutta, Siddhant, et al.
Publicado: (2026)

Generative Active Learning for the Search of Small-molecule Protein Binders
por: Korablyov, Maksym, et al.
Publicado: (2024)

OneProt: Towards Multi-Modal Protein Foundation Models
por: Flöge, Klemens, et al.
Publicado: (2024)

Internal-Coordinate Density Modelling of Protein Structure: Covariance Matters
por: Arts, Marloes, et al.
Publicado: (2023)

Insights Into the Inner Workings of Transformer Models for Protein Function Prediction
por: Wenzel, Markus, et al.
Publicado: (2023)

A Model-Centric Review of Deep Learning for Protein Design
por: Kyro, Gregory W., et al.
Publicado: (2025)

Protein-Mamba: Biological Mamba Models for Protein Function Prediction
por: Xu, Bohao, et al.
Publicado: (2024)

ChemSpaceAL: An Efficient Active Learning Methodology Applied to Protein-Specific Molecular Generation
por: Kyro, Gregory W., et al.
Publicado: (2023)

Efficiently Predicting Mutational Effect on Homologous Proteins by Evolution Encoding
por: Zhong, Zhiqiang, et al.
Publicado: (2024)

ProteinWeaver: A Divide-and-Assembly Approach for Protein Backbone Design
por: Ma, Yiming, et al.
Publicado: (2024)

FoldMark: Protecting Protein Generative Models with Watermarking
por: Zhang, Zaixi, et al.
Publicado: (2024)