MAB-DQA: Addressing Query Aspect Importance in Document Question Answering with Multi-Armed Bandits

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xiang, Yixin, Ma, Yunshan, Du, Xiaoyu, Chen, Yibing, Zhang, Yanxin, Tang, Jinhui
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917412735025152
author Xiang, Yixin
Ma, Yunshan
Du, Xiaoyu
Chen, Yibing
Zhang, Yanxin
Tang, Jinhui
author_facet Xiang, Yixin
Ma, Yunshan
Du, Xiaoyu
Chen, Yibing
Zhang, Yanxin
Tang, Jinhui
contents Document Question Answering (DQA) involves generating answers from a document based on a user's query, representing a key task in document understanding. This task requires interpreting visual layouts, which has prompted recent studies to adopt multimodal Retrieval-Augmented Generation (RAG) that processes page images for answer generation. However, in multimodal RAG, visual DQA struggles to utilize a large number of images effectively, as the retrieval stage often retains only a few candidate pages (e.g., Top-4), causing informative but less visually salient content to be overlooked in favor of common yet low-information pages. To address this issue, we propose a Multi-Armed Bandit-based DQA framework (MAB-DQA) to explicitly model the varying importance of multiple implicit aspects in a query. Specifically, MAB-DQA decomposes a query into aspect-aware subqueries and retrieves an aspect-specific candidate set for each. It treats each subquery as an arm and uses preliminary reasoning results from a small number of representative pages as reward signals to estimate aspect utility. Guided by an exploration-exploitation policy, MAB-DQA dynamically reallocates retrieval budgets toward high-value aspects. With the most informative pages and their correlations, MAB-DQA generates the expected results. On four benchmarks, MAB-DQA shows an average improvement of 5%-18% over the state-of-the-art method, consistently enhancing document understanding. Codes are available at https://github.com/ElephantOH/MAB-DQA.
format Preprint
id arxiv_https___arxiv_org_abs_2604_08952
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MAB-DQA: Addressing Query Aspect Importance in Document Question Answering with Multi-Armed Bandits
Xiang, Yixin
Ma, Yunshan
Du, Xiaoyu
Chen, Yibing
Zhang, Yanxin
Tang, Jinhui
Computation and Language
Information Retrieval
I.2.7; H.3.3
Document Question Answering (DQA) involves generating answers from a document based on a user's query, representing a key task in document understanding. This task requires interpreting visual layouts, which has prompted recent studies to adopt multimodal Retrieval-Augmented Generation (RAG) that processes page images for answer generation. However, in multimodal RAG, visual DQA struggles to utilize a large number of images effectively, as the retrieval stage often retains only a few candidate pages (e.g., Top-4), causing informative but less visually salient content to be overlooked in favor of common yet low-information pages. To address this issue, we propose a Multi-Armed Bandit-based DQA framework (MAB-DQA) to explicitly model the varying importance of multiple implicit aspects in a query. Specifically, MAB-DQA decomposes a query into aspect-aware subqueries and retrieves an aspect-specific candidate set for each. It treats each subquery as an arm and uses preliminary reasoning results from a small number of representative pages as reward signals to estimate aspect utility. Guided by an exploration-exploitation policy, MAB-DQA dynamically reallocates retrieval budgets toward high-value aspects. With the most informative pages and their correlations, MAB-DQA generates the expected results. On four benchmarks, MAB-DQA shows an average improvement of 5%-18% over the state-of-the-art method, consistently enhancing document understanding. Codes are available at https://github.com/ElephantOH/MAB-DQA.
title MAB-DQA: Addressing Query Aspect Importance in Document Question Answering with Multi-Armed Bandits
topic Computation and Language
Information Retrieval
I.2.7; H.3.3
url https://arxiv.org/abs/2604.08952