Imagen de Portada

Chartographer: Counterfactual Chart Generation for Evaluating Vision-Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Jiang, Yifan, Hwang, Dae Yon, Cresswell, Jesse C., Shi, Freda
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language Computer Vision and Pattern Recognition
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Learning Language Structures through Grounding
por: Shi, Freda
Publicado: (2024)

MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart Problems
por: Zhu, Zifeng, et al.
Publicado: (2024)

Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguities
por: Zhang, Zheyuan, et al.
Publicado: (2024)

ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering
por: Wu, Yifan, et al.
Publicado: (2024)

Judging the Judges: Can Large Vision-Language Models Fairly Evaluate Chart Comprehension and Reasoning?
por: Laskar, Md Tahmid Rahman, et al.
Publicado: (2025)

From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models
por: Wu, Juncheng, et al.
Publicado: (2026)

ChartHal: A Fine-grained Framework Evaluating Hallucination of Large Vision Language Models in Chart Understanding
por: Wang, Xingqi, et al.
Publicado: (2025)

ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models
por: Tang, Liyan, et al.
Publicado: (2025)

From Behavioral Performance to Internal Competence: Interpreting Vision-Language Models with VLM-Lens
por: Sheta, Hala, et al.
Publicado: (2025)

The Mechanistic Emergence of Symbol Grounding in Language Models
por: Wu, Shuyu, et al.
Publicado: (2025)

SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data
por: Ogezi, Michael, et al.
Publicado: (2025)

Do Vision-Language Models Really Understand Visual Language?
por: Hou, Yifan, et al.
Publicado: (2024)

ChartGalaxy: A Dataset for Infographic Chart Understanding and Generation
por: Li, Zhen, et al.
Publicado: (2025)

ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generation
por: Yang, Cheng, et al.
Publicado: (2024)

Evaluating Vision Language Model Adaptations for Radiology Report Generation in Low-Resource Languages
por: Salmè, Marco, et al.
Publicado: (2025)

Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos
por: Chen, Haodong, et al.
Publicado: (2026)

Intriguing Properties of Large Language and Vision Models
por: Lee, Young-Jun, et al.
Publicado: (2024)

Evaluating Vision-Language Models as Evaluators in Path Planning
por: Aghzal, Mohamed, et al.
Publicado: (2024)

Charting the Future: Using Chart Question-Answering for Scalable Evaluation of LLM-Driven Data Visualizations
por: Ford, James, et al.
Publicado: (2024)

Evaluating Vision-Language Models for Emotion Recognition
por: Bhattacharyya, Sree, et al.
Publicado: (2025)

Evaluation of Cultural Competence of Vision-Language Models
por: Yadav, Srishti, et al.
Publicado: (2025)

From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models
por: Bhatia, Mehar, et al.
Publicado: (2024)

NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samples
por: Li, Baiqi, et al.
Publicado: (2024)

CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation
por: Deng, Dazhen, et al.
Publicado: (2025)

Cultural Counterfactuals: Evaluating Cultural Biases in Large Vision-Language Models with Counterfactual Examples
por: Howard, Phillip, et al.
Publicado: (2026)

VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Models
por: Li, Lei, et al.
Publicado: (2024)

Pseudo-Prompt Generating in Pre-trained Vision-Language Models for Multi-Label Medical Image Classification
por: Ye, Yaoqin, et al.
Publicado: (2024)

Can Vision-Language Models Evaluate Handwritten Math?
por: Nath, Oikantik, et al.
Publicado: (2025)

Instruction-Following Evaluation of Large Vision-Language Models
por: Shiono, Daiki, et al.
Publicado: (2025)

Constructing Multilingual Visual-Text Datasets Revealing Visual Multilingual Ability of Vision Language Models
por: Atuhurra, Jesse, et al.
Publicado: (2024)

Why Vision Language Models Struggle with Visual Arithmetic? Towards Enhanced Chart and Geometry Understanding
por: Huang, Kung-Hsiang, et al.
Publicado: (2025)

POLYCHARTQA: Benchmarking Large Vision-Language Models with Multilingual Chart Question Answering
por: Xu, Yichen, et al.
Publicado: (2025)

WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences
por: Lu, Yujie, et al.
Publicado: (2024)

Evaluation and Enhancement of Semantic Grounding in Large Vision-Language Models
por: Lu, Jiaying, et al.
Publicado: (2023)

Evaluating Reasoning Faithfulness in Medical Vision-Language Models using Multimodal Perturbations
por: Moll, Johannes, et al.
Publicado: (2025)

MSG-Chart: Multimodal Scene Graph for ChartQA
por: Dai, Yue, et al.
Publicado: (2024)

NPHardEval4V: Dynamic Evaluation of Large Vision-Language Models with Effects of Vision
por: Li, Xiang, et al.
Publicado: (2024)

Mitigating Hallucinations in Large Vision-Language Models by Self-Injecting Hallucinations
por: Lu, Yifan, et al.
Publicado: (2025)

CANVAS: A Benchmark for Vision-Language Models on Tool-Based User Interface Design
por: Jeong, Daeheon, et al.
Publicado: (2025)

Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving
por: Li, Yue, et al.
Publicado: (2025)