Cover Image

EvoLlama: Enhancing LLMs' Understanding of Proteins via Multimodal Structure and Sequence Representations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Nuowei, Sun, Changzhi, Ji, Tao, Tian, Junfeng, Tang, Jianxin, Wu, Yuanbin, Lan, Man
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Protein Design with Dynamic Protein Vocabulary
by: Liu, Nuowei, et al.
Published: (2025)

PDFBench: A Benchmark for De novo Protein Design from Function
by: Kuang, Jiahao, et al.
Published: (2025)

CERD: A Comprehensive Chinese Rhetoric Dataset for Rhetorical Understanding and Generation in Essays
by: Liu, Nuowei, et al.
Published: (2024)

Investigating and Mitigating Object Hallucinations in Pretrained Vision-Language (CLIP) Models
by: Liu, Yufang, et al.
Published: (2024)

Generation with Dynamic Vocabulary
by: Liu, Yanting, et al.
Published: (2024)

Stabilizing LLM Supervised Fine-Tuning via Explicit Distributional Control
by: Wang, Xinyu, et al.
Published: (2026)

DVAGen: Dynamic Vocabulary Augmented Generation
by: Du, Wei, et al.
Published: (2025)

Logic-Regularized Verifier Elicits Reasoning from LLMs
by: Wang, Xinyu, et al.
Published: (2026)

PRISM: Enhancing Protein Inverse Folding through Fine-Grained Retrieval on Structure-Sequence Multimodal Representations
by: Mahbub, Sazan, et al.
Published: (2025)

Structure-Enhanced Protein Instruction Tuning: Towards General-Purpose Protein Understanding with LLMs
by: Wu, Wei, et al.
Published: (2024)

STELLA: A Multimodal LLM for Protein Functional Annotation via Unified Sequence-Structure Encoding
by: Xiao, Hongwang, et al.
Published: (2025)

ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understanding
by: Xiao, Yijia, et al.
Published: (2024)

Understanding Multimodal Hallucination with Parameter-Free Representation Alignment
by: Wang, Yueqian, et al.
Published: (2024)

EvoGM: Learning to Merge LLMs via Evolutionary Generative Optimization
by: Jiang, Tao, et al.
Published: (2026)

Protein Representation Learning by Capturing Protein Sequence-Structure-Function Relationship
by: Ko, Eunji, et al.
Published: (2024)

Diffusion Sequence Models for Enhanced Protein Representation and Generation
by: Hallee, Logan, et al.
Published: (2025)

TACO: Enhancing Multimodal In-context Learning via Task Mapping-Guided Sequence Configuration
by: Li, Yanshu, et al.
Published: (2025)

SFM-Protein: Integrative Co-evolutionary Pre-training for Advanced Protein Sequence Representation
by: He, Liang, et al.
Published: (2024)

Structured Attention Matters to Multimodal LLMs in Document Understanding
by: Liu, Chang, et al.
Published: (2025)

EvoMoE: Expert Evolution in Mixture of Experts for Multimodal Large Language Models
by: Jing, Linglin, et al.
Published: (2025)

S$^2$Drug: Bridging Protein Sequence and 3D Structure in Contrastive Representation Learning for Virtual Screening
by: He, Bowei, et al.
Published: (2025)

LlamaF: An Efficient Llama2 Architecture Accelerator on Embedded FPGAs
by: Xu, Han, et al.
Published: (2024)

Structuring Value Representations via Geometric Coherence in Markov Decision Processes
by: Zhang, Zuyuan, et al.
Published: (2026)

EvoWiki: Evaluating LLMs on Evolving Knowledge
by: Tang, Wei, et al.
Published: (2024)

DNAZEN: Enhanced Gene Sequence Representations via Mixed Granularities of Coding Units
by: Mao, Lei, et al.
Published: (2025)

MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulation
by: Liu, Zhuoyang, et al.
Published: (2025)

PanoLlama: Generating Endless and Coherent Panoramas with Next-Token-Prediction LLMs
by: Zhou, Teng, et al.
Published: (2024)

Llama See, Llama Do: A Mechanistic Perspective on Contextual Entrainment and Distraction in LLMs
by: Niu, Jingcheng, et al.
Published: (2025)

EvoIF: Evolutionary Profiles for Protein Fitness Prediction
by: Jiao, Xiaoran, et al.
Published: (2026)

Harmonizing Visual Representations for Unified Multimodal Understanding and Generation
by: Wu, Size, et al.
Published: (2025)

EvoStruct: Bridging Evolutionary and Structural Priors for Antibody CDR Design via Protein Language Model Adaptation
by: Ahmed, Mansoor, et al.
Published: (2026)

Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manuals
by: Wu, Te-Lin, et al.
Published: (2021)

TASO: Task-Aligned Sparse Optimization for Parameter-Efficient Model Adaptation
by: Miao, Daiye, et al.
Published: (2025)

Investigating Bias Representations in Llama 2 Chat via Activation Steering
by: Lu, Dawn, et al.
Published: (2024)

LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs
by: Park, Chansung, et al.
Published: (2024)

VAInpaint: Zero-Shot Video-Audio inpainting framework with LLMs-driven Module
by: Wu, Kam Man, et al.
Published: (2025)

Scaling the Long Video Understanding of Multimodal Large Language Models via Visual Memory Mechanism
by: Chen, Tao, et al.
Published: (2026)

Llama-Affinity: A Predictive Antibody Antigen Binding Model Integrating Antibody Sequences with Llama3 Backbone Architecture
by: Hossain, Delower, et al.
Published: (2025)

Global Optimization on Graph-Structured Data via Gaussian Processes with Spectral Representations
by: Hong, Shu, et al.
Published: (2025)

Diffusion-Based Cross-Modal Feature Extraction for Multi-Label Classification
by: Lan, Tian, et al.
Published: (2025)