Cover Image

Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfacts

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Golovanevsky, Michal, Rudman, William, Lepori, Michael, Bar, Amir, Singh, Ritambhara, Eickhoff, Carsten
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Is There Knowledge Left to Extract? Evidence of Fragility in Medically Fine-Tuned Vision-Language Models
by: McLaughlin, Oliver, et al.
Published: (2026)

Forgotten Polygons: Multimodal Large Language Models are Shape-Blind
by: Rudman, William, et al.
Published: (2025)

Mechanisms of Prompt-Induced Hallucination in Vision-Language Models
by: Rudman, William, et al.
Published: (2026)

What Do VLMs NOTICE? A Mechanistic Interpretability Pipeline for Gaussian-Noise-free Text-Image Corruption and Evaluation
by: Golovanevsky, Michal, et al.
Published: (2024)

Less is More: Label-Guided Summarization of Procedural and Instructional Videos
by: Rajpal, Shreya, et al.
Published: (2026)

PiCME: Pipeline for Contrastive Modality Evaluation and Encoding in the MIMIC Dataset
by: Golovanevsky, Michal, et al.
Published: (2025)

When to Call an Apple Red: Humans Follow Introspective Rules, VLMs Don't
by: Nemitz, Jonathan, et al.
Published: (2026)

One-Versus-Others Attention: Scalable Multimodal Integration for Biomedical Data
by: Golovanevsky, Michal, et al.
Published: (2023)

InPK: Infusing Prior Knowledge into Prompt for Vision-Language Models
by: Zhou, Shuchang, et al.
Published: (2025)

Stable Anisotropic Regularization
by: Rudman, William, et al.
Published: (2023)

PriorCLIP: Visual Prior Guided Vision-Language Model for Remote Sensing Image-Text Retrieval
by: Pan, Jiancheng, et al.
Published: (2024)

Outlier Dimensions Encode Task-Specific Knowledge
by: Rudman, William, et al.
Published: (2023)

Expanding the Boundaries of Vision Prior Knowledge in Multi-modal Large Language Models
by: Liang, Qiao, et al.
Published: (2025)

Active Prompt Learning with Vision-Language Model Priors
by: Kim, Hoyoung, et al.
Published: (2024)

$Δ$VLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variation
by: Zhu, Yijie, et al.
Published: (2026)

Leveraging Language Prior for Infrared Small Target Detection
by: Singh, Pranav, et al.
Published: (2025)

Overcoming Language Priors for Visual Question Answering Based on Knowledge Distillation
by: Peng, Daowan, et al.
Published: (2025)

The Persona Paradox: Medical Personas as Behavioral Priors in Clinical Language Models
by: Abdullahi, Tassallah, et al.
Published: (2026)

Probing Visual Language Priors in VLMs
by: Luo, Tiange, et al.
Published: (2024)

Revisiting the Role of Language Priors in Vision-Language Models
by: Lin, Zhiqiu, et al.
Published: (2023)

LanP: Rethinking the Impact of Language Priors in Large Vision-Language Models
by: Wu, Zongyu, et al.
Published: (2025)

Source-Free Domain Adaptation with Vision-Language Prior
by: Tang, Song, et al.
Published: (2026)

Osmosis: RGBD Diffusion Prior for Underwater Image Restoration
by: Nathan, Opher Bar, et al.
Published: (2024)

Vision-Language Models Create Cross-Modal Task Representations
by: Luo, Grace, et al.
Published: (2024)

Retrieval Augmented Zero-Shot Text Classification
by: Abdullahi, Tassallah, et al.
Published: (2024)

Light Cones For Vision: Simple Causal Priors For Visual Hierarchy
by: Kartik, Manglam, et al.
Published: (2026)

Leveraging Prior Knowledge of Diffusion Model for Person Search
by: Kim, Giyeol, et al.
Published: (2025)

SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors
by: Ma, Chenyang, et al.
Published: (2024)

VideoSketcher: Video Models Prior Enable Versatile Sequential Sketch Generation
by: Ren, Hui, et al.
Published: (2026)

Depth as Prior Knowledge for Object Detection
by: Sbeyti, Moussa Kassem, et al.
Published: (2026)

Diffusion Models Need Visual Priors for Image Generation
by: Yue, Xiaoyu, et al.
Published: (2024)

Neural Human Pose Prior
by: Heker, Michal, et al.
Published: (2025)

Vision Transformer with Sparse Scan Prior
by: Zhang, Yuguang, et al.
Published: (2024)

TRIM: Achieving Extreme Sparsity with Targeted Row-wise Iterative Metric-driven Pruning
by: Beck, Florentin, et al.
Published: (2025)

VLind-Bench: Measuring Language Priors in Large Vision-Language Models
by: Lee, Kang-il, et al.
Published: (2024)

HaltNav: Reactive Visual Halting over Lightweight Topological Priors for Robust Vision-Language Navigation
by: Yu, Zihui, et al.
Published: (2026)

RoboGround: Robotic Manipulation with Grounded Vision-Language Priors
by: Huang, Haifeng, et al.
Published: (2025)

Cross-Image Contrastive Decoding: Precise, Lossless Suppression of Language Priors in Large Vision-Language Models
by: Zhao, Jianfei, et al.
Published: (2025)

Holistic Visual-Textual Sentiment Analysis with Prior Models
by: Chen, Junyu, et al.
Published: (2022)

Fully Exploiting Vision Foundation Model's Profound Prior Knowledge for Generalizable RGB-Depth Driving Scene Parsing
by: Guo, Sicen, et al.
Published: (2025)