Cover Image

Unraveling the Truth: Do VLMs really Understand Charts? A Deep Dive into Consistency and Robustness

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mukhopadhyay, Srija, Qidwai, Adnan, Garimella, Aparna, Ramu, Pritika, Gupta, Vivek, Roth, Dan
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Computer Vision and Pattern Recognition Human-Computer Interaction Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PRAISE: Enhancing Product Descriptions with LLM-Driven Structured Insights
by: Qidwai, Adnan, et al.
Published: (2025)

Doc2Chart: Intent-Driven Zero-Shot Chart Generation from Documents
by: Jain, Akriti, et al.
Published: (2025)

InterChart: Benchmarking Visual Reasoning Across Decomposed and Distributed Chart Information
by: Iyengar, Anirudh Iyengar Kaniyar Narayana, et al.
Published: (2025)

MAPWise: Evaluating Vision-Language Models for Advanced Map Queries
by: Mukhopadhyay, Srija, et al.
Published: (2024)

Is This a Bad Table? A Closer Look at the Evaluation of Table Generation from Text
by: Ramu, Pritika, et al.
Published: (2024)

An Answer is just the Start: Related Insight Generation for Open-Ended Document-Grounded QA
by: Sharma, Saransh, et al.
Published: (2026)

Infogen: Generating Complex Statistical Infographics from Documents
by: Ghosh, Akash, et al.
Published: (2025)

Decisive: Guiding User Decisions with Optimal Preference Elicitation from Unstructured Documents
by: Jain, Akriti, et al.
Published: (2026)

Beyond Screenshots: Evaluating VLMs' Understanding of UI Animations
by: Liang, Chen, et al.
Published: (2026)

ChartGen: Scaling Chart Understanding Via Code-Guided Synthetic Chart Generation
by: Kondic, Jovana, et al.
Published: (2025)

Elevating Information System Performance: A Deep Dive into Quality Metrics
by: Abdullah, Dana A, et al.
Published: (2024)

VegaChat: A Robust Framework for LLM-Based Chart Generation and Assessment
by: Hostnik, Marko, et al.
Published: (2026)

Framing Perception: Exploring Camera Induced Objectification in Cinema
by: Maradia, Parth, et al.
Published: (2025)

Reviving Static Charts into Live Charts
by: Ying, Lu, et al.
Published: (2023)

Chart-to-Experience: Benchmarking Multimodal LLMs for Predicting Experiential Impact of Charts
by: Kim, Seon Gyeom, et al.
Published: (2025)

Do Vision-Language Models See Visualizations Like Humans? Alignment in Chart Categorization
by: Gyarmati, Péter Ferenc, et al.
Published: (2025)

Generation Z's Ability to Discriminate Between AI-generated and Human-Authored Text on Discord
by: Ramu, Dhruv, et al.
Published: (2023)

TabReX : Tabular Referenceless eXplainable Evaluation
by: Anvekar, Tejas, et al.
Published: (2025)

ChartOptimiser: Task-driven Optimisation of Chart Designs
by: Wang, Yao, et al.
Published: (2025)

Multi-Intent Recognition in Dialogue Understanding: A Comparison Between Smaller Open-Source LLMs
by: Ahmad, Adnan, et al.
Published: (2025)

RELATE-Sim: Leveraging Turning Point Theory and LLM Agents to Predict and Understand Long-Term Relationship Dynamics through Interactive Narrative Simulations
by: Yue, Matthew, et al.
Published: (2025)

Chart4Blind: An Intelligent Interface for Chart Accessibility Conversion
by: Moured, Omar, et al.
Published: (2024)

Can LLMs Synthesize Court-Ready Statistical Evidence? Evaluating AI-Assisted Sentencing Bias Analysis for California Racial Justice Act Claims
by: Komarla, Aparna
Published: (2026)

ChartInsighter: An Approach for Mitigating Hallucination in Time-series Chart Summary Generation with A Benchmark Dataset
by: Wang, Fen, et al.
Published: (2025)

The Truth, the Whole Truth, and Nothing but the Truth: Automatic Visualization Evaluation from Reconstruction Quality
by: Bujack, Roxana, et al.
Published: (2026)

ChartBlender: An Interactive System for Authoring and Synchronizing Visualization Charts in Video
by: He, Yi, et al.
Published: (2025)

How Do LLMs See Charts? A Comparative Study on High-Level Visualization Comprehension in Humans and LLMs
by: Jeon, Hyotaek, et al.
Published: (2026)

EICAP: Deep Dive in Assessment and Enhancement of Large Language Models in Emotional Intelligence through Multi-Turn Conversations
by: Nazar, Nizi, et al.
Published: (2025)

Beyond correlation: The Impact of Human Uncertainty in Measuring the Effectiveness of Automatic Evaluation and LLM-as-a-Judge
by: Elangovan, Aparna, et al.
Published: (2024)

ChartEditor: A Human-AI Paired Tool for Authoring Pictorial Charts
by: Yan, Siyu, et al.
Published: (2025)

ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Language
by: Tian, Yuan, et al.
Published: (2023)

How Students (Really) Use ChatGPT: Uncovering Experiences Among Undergraduate Students
by: Ammari, Tawfiq, et al.
Published: (2025)

Learning to Live with AI: How Students Develop AI Literacy Through Naturalistic ChatGPT Interaction
by: Ammari, Tawfiq, et al.
Published: (2026)

Do They Understand What They Are Using? -- Assessing Perception and Usage of Biometrics
by: Mecke, Lukas, et al.
Published: (2024)

Illusions of Confidence? Diagnosing LLM Truthfulness via Neighborhood Consistency
by: Xu, Haoming, et al.
Published: (2026)

Chart What I Say: Exploring Cross-Modality Prompt Alignment in AI-Assisted Chart Authoring
by: Ponochevnyi, Nazar, et al.
Published: (2024)

Can VLMs Assess Similarity Between Graph Visualizations?
by: Jung, Seokweon, et al.
Published: (2025)

Unraveling Entangled Feeds: Rethinking Social Media Design to Enhance User Well-being
by: Milton, Ashlee, et al.
Published: (2026)

How Aligned are Human Chart Takeaways and LLM Predictions? A Case Study on Bar Charts with Varying Layouts
by: Wang, Huichen Will, et al.
Published: (2024)

MapIQ: Evaluating Multimodal Large Language Models for Map Question Answering
by: Srivastava, Varun, et al.
Published: (2025)