When Vision-Language Models Judge Without Seeing: Exposing Informativeness Bias
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Zou, Xiaohan, Sridhar, Roshan, Safarzadeh, Mohammadtaher, Roth, Dan |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Evaluating NL2SQL via SQL2NL
par: Safarzadeh, Mohammadtaher, et autres
Publié: (2025)
par: Safarzadeh, Mohammadtaher, et autres
Publié: (2025)
SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarks
par: Safarzadeh, Mohammadtaher, et autres
Publié: (2026)
par: Safarzadeh, Mohammadtaher, et autres
Publié: (2026)
Freeze and Reveal: Exposing Modality Bias in Vision-Language Models
par: Kavuri, Vivek Hruday, et autres
Publié: (2025)
par: Kavuri, Vivek Hruday, et autres
Publié: (2025)
Hidden Clones: Exposing and Fixing Family Bias in Vision-Language Model Ensembles
par: Bugaud, Zacharie
Publié: (2026)
par: Bugaud, Zacharie
Publié: (2026)
Tree-based Dialogue Reinforced Policy Optimization for Red-Teaming Attacks
par: Guo, Ruohao, et autres
Publié: (2025)
par: Guo, Ruohao, et autres
Publié: (2025)
When Seeing Overrides Knowing: Disentangling Knowledge Conflicts in Vision-Language Models
par: Ortu, Francesco, et autres
Publié: (2025)
par: Ortu, Francesco, et autres
Publié: (2025)
Vision Language Models See What You Want but not What You See
par: Gao, Qingying, et autres
Publié: (2024)
par: Gao, Qingying, et autres
Publié: (2024)
Large Causal Models from Large Language Models
par: Mahadevan, Sridhar
Publié: (2025)
par: Mahadevan, Sridhar
Publié: (2025)
HInter: Exposing Hidden Intersectional Bias in Large Language Models
par: Souani, Badr, et autres
Publié: (2025)
par: Souani, Badr, et autres
Publié: (2025)
When Agents See Humans as the Outgroup: Belief-Dependent Bias in LLM-Powered Agents
par: Wang, Zongwei, et autres
Publié: (2026)
par: Wang, Zongwei, et autres
Publié: (2026)
Jigsaw-Puzzles: From Seeing to Understanding to Reasoning in Vision-Language Models
par: Lyu, Zesen, et autres
Publié: (2025)
par: Lyu, Zesen, et autres
Publié: (2025)
Efficient Bias Mitigation Without Privileged Information
par: Zarlenga, Mateo Espinosa, et autres
Publié: (2024)
par: Zarlenga, Mateo Espinosa, et autres
Publié: (2024)
Judging the Judges: A Systematic Evaluation of Bias Mitigation Strategies in LLM-as-a-Judge Pipelines
par: Soumik, Sadman Kabir
Publié: (2026)
par: Soumik, Sadman Kabir
Publié: (2026)
Multimodal Language Models See Better When They Look Shallower
par: Chen, Haoran, et autres
Publié: (2025)
par: Chen, Haoran, et autres
Publié: (2025)
Automated Localization of Blood Vessels in Retinal Images
par: Safarzadeh, Vahid Mohammadi
Publié: (2023)
par: Safarzadeh, Vahid Mohammadi
Publié: (2023)
RICL: Adding In-Context Adaptability to Pre-Trained Vision-Language-Action Models
par: Sridhar, Kaustubh, et autres
Publié: (2025)
par: Sridhar, Kaustubh, et autres
Publié: (2025)
A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners
par: Jiang, Bowen, et autres
Publié: (2024)
par: Jiang, Bowen, et autres
Publié: (2024)
Seeing the Abstract: Translating the Abstract Language for Vision Language Models
par: Talon, Davide, et autres
Publié: (2025)
par: Talon, Davide, et autres
Publié: (2025)
Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judge
par: Shi, Lin, et autres
Publié: (2024)
par: Shi, Lin, et autres
Publié: (2024)
Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Models
par: Kumar, Shachi H, et autres
Publié: (2024)
par: Kumar, Shachi H, et autres
Publié: (2024)
CorBenchX: Large-Scale Chest X-Ray Error Dataset and Vision-Language Model Benchmark for Report Error Correction
par: Zou, Jing, et autres
Publié: (2025)
par: Zou, Jing, et autres
Publié: (2025)
BLINK: Multimodal Large Language Models Can See but Not Perceive
par: Fu, Xingyu, et autres
Publié: (2024)
par: Fu, Xingyu, et autres
Publié: (2024)
When AIs Judge AIs: The Rise of Agent-as-a-Judge Evaluation for LLMs
par: Yu, Fangyi
Publié: (2025)
par: Yu, Fangyi
Publié: (2025)
Egocentric Bias in Vision-Language Models
par: Wang, Maijunxian, et autres
Publié: (2026)
par: Wang, Maijunxian, et autres
Publié: (2026)
Judging by Appearances? Auditing and Intervening Vision-Language Models for Bail Prediction
par: Basu, Sagnik, et autres
Publié: (2025)
par: Basu, Sagnik, et autres
Publié: (2025)
Fairness or Fluency? An Investigation into Language Bias of Pairwise LLM-as-a-Judge
par: Zhou, Xiaolin, et autres
Publié: (2026)
par: Zhou, Xiaolin, et autres
Publié: (2026)
Context Over Content: Exposing Evaluation Faking in Automated Judges
par: Gupta, Manan, et autres
Publié: (2026)
par: Gupta, Manan, et autres
Publié: (2026)
JAF: Judge Agent Forest
par: Garg, Sahil, et autres
Publié: (2026)
par: Garg, Sahil, et autres
Publié: (2026)
Not All Tokens See Equally: Perception-Grounded Policy Optimization for Large Vision-Language Models
par: Ye, Zekai, et autres
Publié: (2026)
par: Ye, Zekai, et autres
Publié: (2026)
Exposing Product Bias in LLM Investment Recommendation
par: Zhi, Yuhan, et autres
Publié: (2025)
par: Zhi, Yuhan, et autres
Publié: (2025)
SocREval: Large Language Models with the Socratic Method for Reference-Free Reasoning Evaluation
par: He, Hangfeng, et autres
Publié: (2023)
par: He, Hangfeng, et autres
Publié: (2023)
JudgeLRM: Large Reasoning Models as a Judge
par: Chen, Nuo, et autres
Publié: (2025)
par: Chen, Nuo, et autres
Publié: (2025)
Seeing Through Experts Eyes A Foundational Vision Language Model Trained on Radiologists Gaze and Reasoning
par: Lee, Kinhei, et autres
Publié: (2026)
par: Lee, Kinhei, et autres
Publié: (2026)
Topos Causal Models
par: Mahadevan, Sridhar
Publié: (2025)
par: Mahadevan, Sridhar
Publié: (2025)
Beyond Consensus: Mitigating the Agreeableness Bias in LLM Judge Evaluations
par: Jain, Suryaansh, et autres
Publié: (2025)
par: Jain, Suryaansh, et autres
Publié: (2025)
PairBench: Are Vision-Language Models Reliable at Comparing What They See?
par: Feizi, Aarash, et autres
Publié: (2025)
par: Feizi, Aarash, et autres
Publié: (2025)
Discovering Latent Knowledge in Language Models Without Supervision
par: Burns, Collin, et autres
Publié: (2022)
par: Burns, Collin, et autres
Publié: (2022)
Mitigating Translationese Bias in Multilingual LLM-as-a-Judge via Disentangled Information Bottleneck
par: Zhang, Hongbin, et autres
Publié: (2026)
par: Zhang, Hongbin, et autres
Publié: (2026)
Beyond Reproducibility: Token Probabilities Expose Large Language Model Nondeterminism
par: Fu, Tairan, et autres
Publié: (2026)
par: Fu, Tairan, et autres
Publié: (2026)
Benchmarking Adversarial Robustness to Bias Elicitation in Large Language Models: Scalable Automated Assessment with LLM-as-a-Judge
par: Cantini, Riccardo, et autres
Publié: (2025)
par: Cantini, Riccardo, et autres
Publié: (2025)
Documents similaires
-
Evaluating NL2SQL via SQL2NL
par: Safarzadeh, Mohammadtaher, et autres
Publié: (2025) -
SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarks
par: Safarzadeh, Mohammadtaher, et autres
Publié: (2026) -
Freeze and Reveal: Exposing Modality Bias in Vision-Language Models
par: Kavuri, Vivek Hruday, et autres
Publié: (2025) -
Hidden Clones: Exposing and Fixing Family Bias in Vision-Language Model Ensembles
par: Bugaud, Zacharie
Publié: (2026) -
Tree-based Dialogue Reinforced Policy Optimization for Red-Teaming Attacks
par: Guo, Ruohao, et autres
Publié: (2025)