Cover Image

Protein Language Model Zero-Shot Fitness Predictions are Improved by Inference-only Dropout

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ravuri, Aditya, Lawrence, Neil D.
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Transformers as Unrolled Inference in Probabilistic Laplacian Eigenmaps: An Interpretation and Potential Improvements
by: Ravuri, Aditya, et al.
Published: (2025)

Towards One Model for Classical Dimensionality Reduction: A Probabilistic Perspective on UMAP and t-SNE
by: Ravuri, Aditya, et al.
Published: (2024)

Scalable Amortized GPLVMs for Single Cell Transcriptomics Data
by: Zhao, Sarah, et al.
Published: (2024)

No Generation without Representation: Efficient Causal Protein Language Models Enable Zero-Shot Fitness Estimation
by: Eris, Furkan
Published: (2026)

Predicting Language Models' Success at Zero-Shot Probabilistic Prediction
by: Ren, Kevin, et al.
Published: (2025)

Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimation
by: Zeevi, Tal, et al.
Published: (2024)

Dynamic Bundling with Large Language Models for Zero-Shot Inference on Text-Attributed Graphs
by: Zhao, Yusheng, et al.
Published: (2025)

Time-Aware Prior Fitted Networks for Zero-Shot Forecasting with Exogenous Variables
by: Potapczynski, Andres, et al.
Published: (2026)

One-Embedding-Fits-All: Efficient Zero-Shot Time Series Forecasting by a Model Zoo
by: Shi, Hao-Nan, et al.
Published: (2025)

Beyond One-Size-Fits-All: Adaptive Subgraph Denoising for Zero-Shot Graph Learning with Large Language Models
by: Li, Fengzhi, et al.
Published: (2026)

Improving Protein Optimization with Smoothed Fitness Landscapes
by: Kirjner, Andrew, et al.
Published: (2023)

Multi-Scale Representation Learning for Protein Fitness Prediction
by: Zhang, Zuobai, et al.
Published: (2024)

Consistent Zero-Shot Imitation with Contrastive Goal Inference
by: Wantlin, Kathryn, et al.
Published: (2025)

TriFit: Trimodal Fusion with Protein Dynamics for Mutation Fitness Prediction
by: Cho, Seungik
Published: (2026)

On Feature Learning for Titi Monkey Activity Detection
by: Ravuri, Aditya, et al.
Published: (2024)

Zero-Shot Robustification of Zero-Shot Models
by: Adila, Dyah, et al.
Published: (2023)

Evolutionary Profiles for Protein Fitness Prediction
by: Fan, Jigang, et al.
Published: (2025)

A Generalization Theory for Zero-Shot Prediction
by: Mehta, Ronak, et al.
Published: (2025)

Repurposing Protein Language Models for Latent Flow-Based Fitness Optimization
by: Arroyo, Amaru Caceres, et al.
Published: (2026)

Large Language Models Are Zero-Shot Time Series Forecasters
by: Gruver, Nate, et al.
Published: (2023)

Dropout Robustness and Cognitive Profiling of Transformer Models via Stochastic Inference
by: Caiado, Antônio Junior Alves, et al.
Published: (2026)

Zero-Shot Load Forecasting with Large Language Models
by: Liao, Wenlong, et al.
Published: (2024)

LogicDiff: Logic-Guided Denoising Improves Zero-Shot Reasoning in Masked Diffusion Language Models
by: Aman, Shaik
Published: (2026)

Model Merging Improves Zero-Shot Generalization in Bioacoustic Foundation Models
by: Marincione, Davide, et al.
Published: (2025)

Protein Language Models Diverge from Natural Language: Comparative Analysis and Improved Inference
by: Hart, Anna, et al.
Published: (2026)

DPad: Efficient Diffusion Language Models with Suffix Dropout
by: Chen, Xinhua, et al.
Published: (2025)

Zero-Shot Learning with Subsequence Reordering Pretraining for Compound-Protein Interaction
by: Zhang, Hongzhi, et al.
Published: (2025)

Leveraging Prediction Entropy for Automatic Prompt Weighting in Zero-Shot Audio-Language Classification
by: Khoury, Karim El, et al.
Published: (2026)

SeqProFT: Sequence-only Protein Property Prediction with LoRA Finetuning
by: Zhang, Shuo, et al.
Published: (2024)

Extending TWIG: Zero-Shot Predictive Hyperparameter Selection for KGEs based on Graph Structure
by: Sardina, Jeffrey, et al.
Published: (2024)

Zero-Shot Medical Phrase Grounding with Off-the-shelf Diffusion Models
by: Vilouras, Konstantinos, et al.
Published: (2024)

Vision-Language Models are Zero-Shot Reward Models for Reinforcement Learning
by: Rocamonde, Juan, et al.
Published: (2023)

Improving Audio Classification by Transitioning from Zero- to Few-Shot
by: Taylor, James, et al.
Published: (2025)

Inference-Time Toxicity Mitigation in Protein Language Models
by: Burda, Manuel Fernández, et al.
Published: (2026)

Steering Generative Models with Experimental Data for Protein Fitness Optimization
by: Yang, Jason, et al.
Published: (2025)

ProteinZero: Self-Improving Protein Generation via Online Reinforcement Learning
by: Wang, Ziwen, et al.
Published: (2025)

Improving Pediatric Emergency Department Triage with Modality Dropout in Late Fusion Multimodal EHR Models
by: Yang, Tyler, et al.
Published: (2026)

Open-Source Protein Language Models for Function Prediction and Protein Design
by: Pandi, Shivasankaran Vanaja, et al.
Published: (2024)

Modality-Aware Zero-Shot Pruning and Sparse Attention for Efficient Multimodal Edge Inference
by: Sui, Yueyuan, et al.
Published: (2026)

Protriever: End-to-End Differentiable Protein Homology Search for Fitness Prediction
by: Weitzman, Ruben, et al.
Published: (2025)