ODUTQA-MDC: A Task for Open-Domain Underspecified Tabular QA with Multi-turn Dialogue-based Clarification

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Zhensheng, Lin, ZhanTeng, Yang, Wenmian, Zhou, Kun, Zhang, Yiquan, Jia, Weijia
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915942871597056
author Wang, Zhensheng
Lin, ZhanTeng
Yang, Wenmian
Zhou, Kun
Zhang, Yiquan
Jia, Weijia
author_facet Wang, Zhensheng
Lin, ZhanTeng
Yang, Wenmian
Zhou, Kun
Zhang, Yiquan
Jia, Weijia
contents The advancement of large language models (LLMs) has enhanced tabular question answering (Tabular QA), yet they struggle with open-domain queries exhibiting underspecified or uncertain expressions. To address this, we introduce the ODUTQA-MDC task and the first comprehensive benchmark to tackle it. This benchmark includes: (1) a large-scale ODUTQA dataset with 209 tables and 25,105 QA pairs; (2) a fine-grained labeling scheme for detailed evaluation; and (3) a dynamic clarification interface that simulates user feedback for interactive assessment. We also propose MAIC-TQA, a multi-agent framework that excels at detecting ambiguities, clarifying them through dialogue, and refining answers. Experiments validate our benchmark and framework, establishing them as a key resource for advancing conversational, underspecification-aware Tabular QA research.
format Preprint
id arxiv_https___arxiv_org_abs_2604_10159
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ODUTQA-MDC: A Task for Open-Domain Underspecified Tabular QA with Multi-turn Dialogue-based Clarification
Wang, Zhensheng
Lin, ZhanTeng
Yang, Wenmian
Zhou, Kun
Zhang, Yiquan
Jia, Weijia
Computation and Language
Databases
Information Retrieval
Multiagent Systems
The advancement of large language models (LLMs) has enhanced tabular question answering (Tabular QA), yet they struggle with open-domain queries exhibiting underspecified or uncertain expressions. To address this, we introduce the ODUTQA-MDC task and the first comprehensive benchmark to tackle it. This benchmark includes: (1) a large-scale ODUTQA dataset with 209 tables and 25,105 QA pairs; (2) a fine-grained labeling scheme for detailed evaluation; and (3) a dynamic clarification interface that simulates user feedback for interactive assessment. We also propose MAIC-TQA, a multi-agent framework that excels at detecting ambiguities, clarifying them through dialogue, and refining answers. Experiments validate our benchmark and framework, establishing them as a key resource for advancing conversational, underspecification-aware Tabular QA research.
title ODUTQA-MDC: A Task for Open-Domain Underspecified Tabular QA with Multi-turn Dialogue-based Clarification
topic Computation and Language
Databases
Information Retrieval
Multiagent Systems
url https://arxiv.org/abs/2604.10159