Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answering

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Yanjie, Li, Yafei, Sheng, Rui, Chen, Zixin, Lin, Yanna, Qu, Huamin, Chen, Lei, Sun, Yushi
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912988994207744
author Zhang, Yanjie
Li, Yafei
Sheng, Rui
Chen, Zixin
Lin, Yanna
Qu, Huamin
Chen, Lei
Sun, Yushi
author_facet Zhang, Yanjie
Li, Yafei
Sheng, Rui
Chen, Zixin
Lin, Yanna
Qu, Huamin
Chen, Lei
Sun, Yushi
contents Despite the success of Vision-Language Models (VLMs), misleading charts remain a significant challenge due to their deceptive visual structures and distorted data representations. We present ChartCynics, an agentic dual-path framework designed to unmask visual deception via a "skeptical" reasoning paradigm. Unlike holistic models, ChartCynics decouples perception from verification: a Diagnostic Vision Path captures structural anomalies (e.g., inverted axes) through strategic ROI cropping, while an OCR-Driven Data Path ensures numerical grounding. To resolve cross-modal conflicts, we introduce an Agentic Summarizer optimized via a two-stage protocol: Oracle-Informed SFT for reasoning distillation and Deception-Aware GRPO for adversarial alignment. This pipeline effectively penalizes visual traps and enforces logical consistency. Evaluations on two benchmarks show that ChartCynics achieves 74.43% and 64.55% accuracy, providing an absolute performance boost of ~29% over the Qwen3-VL-8B backbone, outperforming state-of-the-art proprietary models. Our results demonstrate that specialized agentic workflows can grant smaller open-source models superior robustness, establishing a new foundation for trustworthy chart interpretation.
format Preprint
id arxiv_https___arxiv_org_abs_2603_28583
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answering
Zhang, Yanjie
Li, Yafei
Sheng, Rui
Chen, Zixin
Lin, Yanna
Qu, Huamin
Chen, Lei
Sun, Yushi
Computer Vision and Pattern Recognition
Artificial Intelligence
Multimedia
Despite the success of Vision-Language Models (VLMs), misleading charts remain a significant challenge due to their deceptive visual structures and distorted data representations. We present ChartCynics, an agentic dual-path framework designed to unmask visual deception via a "skeptical" reasoning paradigm. Unlike holistic models, ChartCynics decouples perception from verification: a Diagnostic Vision Path captures structural anomalies (e.g., inverted axes) through strategic ROI cropping, while an OCR-Driven Data Path ensures numerical grounding. To resolve cross-modal conflicts, we introduce an Agentic Summarizer optimized via a two-stage protocol: Oracle-Informed SFT for reasoning distillation and Deception-Aware GRPO for adversarial alignment. This pipeline effectively penalizes visual traps and enforces logical consistency. Evaluations on two benchmarks show that ChartCynics achieves 74.43% and 64.55% accuracy, providing an absolute performance boost of ~29% over the Qwen3-VL-8B backbone, outperforming state-of-the-art proprietary models. Our results demonstrate that specialized agentic workflows can grant smaller open-source models superior robustness, establishing a new foundation for trustworthy chart interpretation.
title Navigating the Mirage: A Dual-Path Agentic Framework for Robust Misleading Chart Question Answering
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Multimedia
url https://arxiv.org/abs/2603.28583