Cover Image

Pre-Training Protein Bi-level Representation Through Span Mask Strategy On 3D Protein Chains

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhao, Jiale, Zhuang, Wanru, Song, Jia, Li, Yaqi, Lu, Shuqi
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Biomolecules
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Atom-level Protein Representation Learning Improves Protein Structure Prediction
by: Kim, Taewon, et al.
Published: (2026)

MSAGPT: Neural Prompting Protein Structure Prediction via MSA Generative Pre-Training
by: Chen, Bo, et al.
Published: (2024)

ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training
by: Zhuo, Le, et al.
Published: (2024)

Graph-level Protein Representation Learning by Structure Knowledge Refinement
by: Wang, Ge, et al.
Published: (2024)

Protein Representation Learning by Capturing Protein Sequence-Structure-Function Relationship
by: Ko, Eunji, et al.
Published: (2024)

Speak to a Protein: An Interactive Multimodal Co-Scientist for Protein Analysis
by: Navarro, Carles, et al.
Published: (2025)

SE(3)-Equivariant Ternary Complex Prediction Towards Target Protein Degradation
by: Xue, Fanglei, et al.
Published: (2025)

A Survey of Deep Learning Methods in Protein Bioinformatics and its Impact on Protein Design
by: Dai, Weihang
Published: (2025)

Multi-level Interaction Modeling for Protein Mutational Effect Prediction
by: Mo, Yuanle, et al.
Published: (2024)

Ligand-Conditioned Discrete Diffusion for Protein Sequence-Structure Co-Design
by: Wei, Chen, et al.
Published: (2026)

Controlling Repetition in Protein Language Models
by: Zhang, Jiahao, et al.
Published: (2026)

Are Protein Language Models Compute Optimal?
by: Serrano, Yaiza, et al.
Published: (2024)

Group Ligands Docking to Protein Pockets
by: Guan, Jiaqi, et al.
Published: (2025)

Protein Design with Dynamic Protein Vocabulary
by: Liu, Nuowei, et al.
Published: (2025)

AutoBinder Agent: An MCP-Based Agent for End-to-End Protein Binder Design
by: Ge, Fukang, et al.
Published: (2026)

AMix-2: Establishing Protein as a Native Modality in Large Language Models
by: Qiu, Keyue, et al.
Published: (2026)

Non-Canonical Crosslinks Confound Evolutionary Protein Structure Models
by: Lacombe, Romain
Published: (2025)

Quantifying the Role of OpenFold Components in Protein Structure Prediction
by: Hayes, Tyler L., et al.
Published: (2025)

The Dance of Atoms-De Novo Protein Design with Diffusion Model
by: Qin, Yujie, et al.
Published: (2025)

Torsion-Space Diffusion for Protein Backbone Generation with Geometric Refinement
by: Singh, Lakshaditya, et al.
Published: (2025)

AMix-1: A Pathway to Test-Time Scalable Protein Foundation Model
by: Lv, Changze, et al.
Published: (2025)

Orientation-Aware Graph Neural Networks for Protein Structure Representation Learning
by: Li, Jiahan, et al.
Published: (2022)

End-to-End Reverse Screening Identifies Protein Targets of Small Molecules Using HelixFold3
by: Xu, Shengjie, et al.
Published: (2026)

ProteinEngine: Empower LLM with Domain Knowledge for Protein Engineering
by: Shen, Yiqing, et al.
Published: (2024)

TEMPO: Temporal Multi-scale Autoregressive Generation of Protein Conformational Ensembles
by: Xu, Yaoyao, et al.
Published: (2025)

BioBlobs: Unsupervised Discovery of Functional Substructures for Protein Function Prediction
by: Wang, Xin, et al.
Published: (2025)

AnnoDPO: Protein Functional Annotation Learning with Direct Preference Optimization
by: Jiang, Zixuan, et al.
Published: (2025)

Structural Interpretations of Protein Language Model Representations via Differentiable Graph Partitioning
by: Dutta, Siddhant, et al.
Published: (2026)

HelixFold-Multimer: Elevating Protein Complex Structure Prediction to New Heights
by: Fang, Xiaomin, et al.
Published: (2024)

Protein Structure Prediction in the 3D HP Model Using Deep Reinforcement Learning
by: Espitia, Giovanny, et al.
Published: (2024)

Fragment-Masked Diffusion for Molecular Optimization
by: Li, Kun, et al.
Published: (2024)

Flows, straight but not so fast: Exploring the design space of Rectified Flows in Protein Design
by: Chen, Junhua, et al.
Published: (2025)

ProtTeX: Structure-In-Context Reasoning and Editing of Proteins with Large Language Models
by: Ma, Zicheng, et al.
Published: (2025)

Beyond Ensembles: Simulating All-Atom Protein Dynamics in a Learned Latent Space
by: Sengar, Aditya, et al.
Published: (2025)

AdaMR: Adaptable Molecular Representation for Unified Pre-training Strategy
by: Ding, Yan, et al.
Published: (2023)

Dynamic PDB: A New Dataset and a SE(3) Model Extension by Integrating Dynamic Behaviors and Physical Properties in Protein Structures
by: Liu, Ce, et al.
Published: (2024)

BioMiner: A Multi-modal System for Automated Mining of Protein-Ligand Bioactivity Data from Literature
by: Yan, Jiaxian, et al.
Published: (2026)

Protein as a Second Language for LLMs
by: Chen, Xinhui, et al.
Published: (2025)

PFMBench: Protein Foundation Model Benchmark
by: Gao, Zhangyang, et al.
Published: (2025)

ProtFlow: Fast Protein Sequence Design via Flow Matching on Compressed Protein Language Model Embeddings
by: Kong, Zitai, et al.
Published: (2025)