Image de couverture de livre

Chartographer: Counterfactual Chart Generation for Evaluating Vision-Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jiang, Yifan, Hwang, Dae Yon, Cresswell, Jesse C., Shi, Freda
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Learning Language Structures through Grounding
par: Shi, Freda
Publié: (2024)

MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart Problems
par: Zhu, Zifeng, et autres
Publié: (2024)

Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguities
par: Zhang, Zheyuan, et autres
Publié: (2024)

ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering
par: Wu, Yifan, et autres
Publié: (2024)

Judging the Judges: Can Large Vision-Language Models Fairly Evaluate Chart Comprehension and Reasoning?
par: Laskar, Md Tahmid Rahman, et autres
Publié: (2025)

From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models
par: Wu, Juncheng, et autres
Publié: (2026)

ChartHal: A Fine-grained Framework Evaluating Hallucination of Large Vision Language Models in Chart Understanding
par: Wang, Xingqi, et autres
Publié: (2025)

ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models
par: Tang, Liyan, et autres
Publié: (2025)

From Behavioral Performance to Internal Competence: Interpreting Vision-Language Models with VLM-Lens
par: Sheta, Hala, et autres
Publié: (2025)

The Mechanistic Emergence of Symbol Grounding in Language Models
par: Wu, Shuyu, et autres
Publié: (2025)

SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data
par: Ogezi, Michael, et autres
Publié: (2025)

Do Vision-Language Models Really Understand Visual Language?
par: Hou, Yifan, et autres
Publié: (2024)

ChartGalaxy: A Dataset for Infographic Chart Understanding and Generation
par: Li, Zhen, et autres
Publié: (2025)

ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation
par: Yang, Cheng, et autres
Publié: (2024)

Evaluating Vision Language Model Adaptations for Radiology Report Generation in Low-Resource Languages
par: Salmè, Marco, et autres
Publié: (2025)

Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos
par: Chen, Haodong, et autres
Publié: (2026)

Intriguing Properties of Large Language and Vision Models
par: Lee, Young-Jun, et autres
Publié: (2024)

Evaluating Vision-Language Models as Evaluators in Path Planning
par: Aghzal, Mohamed, et autres
Publié: (2024)

Charting the Future: Using Chart Question-Answering for Scalable Evaluation of LLM-Driven Data Visualizations
par: Ford, James, et autres
Publié: (2024)

Evaluating Vision-Language Models for Emotion Recognition
par: Bhattacharyya, Sree, et autres
Publié: (2025)

Evaluation of Cultural Competence of Vision-Language Models
par: Yadav, Srishti, et autres
Publié: (2025)

From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models
par: Bhatia, Mehar, et autres
Publié: (2024)

NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samples
par: Li, Baiqi, et autres
Publié: (2024)

CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation
par: Deng, Dazhen, et autres
Publié: (2025)

Cultural Counterfactuals: Evaluating Cultural Biases in Large Vision-Language Models with Counterfactual Examples
par: Howard, Phillip, et autres
Publié: (2026)

VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Models
par: Li, Lei, et autres
Publié: (2024)

Pseudo-Prompt Generating in Pre-trained Vision-Language Models for Multi-Label Medical Image Classification
par: Ye, Yaoqin, et autres
Publié: (2024)

Can Vision-Language Models Evaluate Handwritten Math?
par: Nath, Oikantik, et autres
Publié: (2025)

Instruction-Following Evaluation of Large Vision-Language Models
par: Shiono, Daiki, et autres
Publié: (2025)

Constructing Multilingual Visual-Text Datasets Revealing Visual Multilingual Ability of Vision Language Models
par: Atuhurra, Jesse, et autres
Publié: (2024)

Why Vision Language Models Struggle with Visual Arithmetic? Towards Enhanced Chart and Geometry Understanding
par: Huang, Kung-Hsiang, et autres
Publié: (2025)

POLYCHARTQA: Benchmarking Large Vision-Language Models with Multilingual Chart Question Answering
par: Xu, Yichen, et autres
Publié: (2025)

WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences
par: Lu, Yujie, et autres
Publié: (2024)

Evaluation and Enhancement of Semantic Grounding in Large Vision-Language Models
par: Lu, Jiaying, et autres
Publié: (2023)

Evaluating Reasoning Faithfulness in Medical Vision-Language Models using Multimodal Perturbations
par: Moll, Johannes, et autres
Publié: (2025)

MSG-Chart: Multimodal Scene Graph for ChartQA
par: Dai, Yue, et autres
Publié: (2024)

NPHardEval4V: Dynamic Evaluation of Large Vision-Language Models with Effects of Vision
par: Li, Xiang, et autres
Publié: (2024)

Mitigating Hallucinations in Large Vision-Language Models by Self-Injecting Hallucinations
par: Lu, Yifan, et autres
Publié: (2025)

CANVAS: A Benchmark for Vision-Language Models on Tool-Based User Interface Design
par: Jeong, Daeheon, et autres
Publié: (2025)

Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving
par: Li, Yue, et autres
Publié: (2025)