Cover Image

Long-context Protein Language Modeling Using Bidirectional Mamba with Shared Projection Layers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Yingheng, Wang, Zichen, Sadeh, Gil, Zancato, Luca, Achille, Alessandro, Karypis, George, Rangwala, Huzefa
Format:	Preprint
Published:	2024
Subjects:	Biomolecules Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Comprehensive Review of Protein Language Models
by: Wang, Lei, et al.
Published: (2025)

Protein-Mamba: Biological Mamba Models for Protein Function Prediction
by: Xu, Bohao, et al.
Published: (2024)

Toward the Explainability of Protein Language Models
by: Hunklinger, Andrea, et al.
Published: (2025)

IDP-Bert: Predicting Properties of Intrinsically Disordered Proteins (IDP) Using Large Language Models
by: Mollaei, Parisa, et al.
Published: (2024)

Controlling Repetition in Protein Language Models
by: Zhang, Jiahao, et al.
Published: (2026)

Guiding Generative Protein Language Models with Reinforcement Learning
by: Stocco, Filippo, et al.
Published: (2024)

Diffusion Language Models Are Versatile Protein Learners
by: Wang, Xinyou, et al.
Published: (2024)

FlexSBDD: Structure-Based Drug Design with Flexible Protein Modeling
by: Zhang, Zaixi, et al.
Published: (2024)

Evaluating and Scoring Ebolavirus Protein-protein Docking Models Using PIsToN
by: Shirali, Azam, et al.
Published: (2025)

Function-Guided Conditional Generation Using Protein Language Models with Adapters
by: Yang, Jason, et al.
Published: (2024)

Challenges and Guidelines in Deep Generative Protein Design: Four Case Studies
by: Zheng, Tianyuan, et al.
Published: (2024)

PLD-Tree: Persistent Laplacian Decision Tree for Protein-Protein Binding Free Energy Prediction
by: Xu, Xingjian, et al.
Published: (2024)

Protein FID: Improved Evaluation of Protein Structure Generative Models
by: Faltings, Felix, et al.
Published: (2025)

Steering Protein Language Models
by: Huang, Long-Kai, et al.
Published: (2025)

Structure-Informed Protein Language Model
by: Zhang, Zuobai, et al.
Published: (2024)

Are Protein Language Models Compute Optimal?
by: Serrano, Yaiza, et al.
Published: (2024)

Open-Source Protein Language Models for Function Prediction and Protein Design
by: Pandi, Shivasankaran Vanaja, et al.
Published: (2024)

Energy Efficient Protein Language Models: Leveraging Small Language Models with LoRA for Controllable Protein Generation
by: Shah, Aayush, et al.
Published: (2024)

Peptide Sequencing Via Protein Language Models
by: Pham, Thuong Le Hoai, et al.
Published: (2024)

Structure Language Models for Protein Conformation Generation
by: Lu, Jiarui, et al.
Published: (2024)

SCOP: A Sequence-Structure Contrast-Aware Framework for Protein Function Prediction
by: Ma, Runze, et al.
Published: (2024)

RiboFlow: Conditional De Novo RNA Co-Design via Synergistic Flow Matching
by: Ma, Runze, et al.
Published: (2025)

Diffusion Sequence Models for Enhanced Protein Representation and Generation
by: Hallee, Logan, et al.
Published: (2025)

ProtScan: Modeling and Prediction of RNA-Protein Interactions
by: Corrado, Gianluca, et al.
Published: (2024)

AMix-2: Establishing Protein as a Native Modality in Large Language Models
by: Qiu, Keyue, et al.
Published: (2026)

Few-shot Protein Fitness Prediction via In-context Learning and Test-time Training
by: Teufel, Felix, et al.
Published: (2025)

Pro-PRIME: A general Temperature-Guided Language model to engineer enhanced Stability and Activity in Proteins
by: Jiang, Fan, et al.
Published: (2023)

Steering Generative Models for Protein Design: Aligning and Conditioning Strategies
by: Stocco, Filippo, et al.
Published: (2025)

Leveraging Deep Generative Model For Computational Protein Design And Optimization
by: Lai, Boqiao
Published: (2024)

Protein-Nucleic Acid Complex Modeling with Frame Averaging Transformer
by: Huang, Tinglin, et al.
Published: (2024)

A Comprehensive System for Secondary Structure Analysis of Protein Models
by: Kannan, Vedh
Published: (2024)

ProtTeX: Structure-In-Context Reasoning and Editing of Proteins with Large Language Models
by: Ma, Zicheng, et al.
Published: (2025)

XDIP: A Curated X-ray Absorption Spectrum Dataset for Iron-Containing Proteins
by: Wang, Yufeng, et al.
Published: (2025)

Interpreting and Steering Protein Language Models through Sparse Autoencoders
by: Garcia, Edith Natalia Villegas, et al.
Published: (2025)

Reverse Distillation: Consistently Scaling Protein Language Model Representations
by: Catrina, Darius, et al.
Published: (2026)

Protein Conformation Generation via Force-Guided SE(3) Diffusion Models
by: Wang, Yan, et al.
Published: (2024)

Fold-switching Proteins
by: Chakravarty, Devlina, et al.
Published: (2025)

DeepRLI: A Multi-objective Framework for Universal Protein--Ligand Interaction Prediction
by: Lin, Haoyu, et al.
Published: (2024)

SeedProteo: Accurate De Novo All-Atom Design of Protein Binders
by: Qu, Wei, et al.
Published: (2025)

Induction Meets Biology: Mechanisms of Repeat Detection in Protein Language Models
by: Pomerants, Gal, et al.
Published: (2026)