S$^3$HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916299454545920 |
|---|---|
| author | Lei, Fangyu Li, Xiang Wei, Yifan He, Shizhu Huang, Yiming Zhao, Jun Liu, Kang |
| author_facet | Lei, Fangyu Li, Xiang Wei, Yifan He, Shizhu Huang, Yiming Zhao, Jun Liu, Kang |
| contents | Answering multi-hop questions over hybrid factual knowledge from the given text and table (TextTableQA) is a challenging task. Existing models mainly adopt a retriever-reader framework, which have several deficiencies, such as noisy labeling in training retriever, insufficient utilization of heterogeneous information over text and table, and deficient ability for different reasoning operations. In this paper, we propose a three-stage TextTableQA framework S3HQA, which comprises of retriever, selector, and reasoner. We use a retriever with refinement training to solve the noisy labeling problem. Then, a hybrid selector considers the linked relationships between heterogeneous data to select the most relevant factual knowledge. For the final stage, instead of adapting a reading comprehension module like in previous methods, we employ a generation-based reasoner to obtain answers. This includes two approaches: a row-wise generator and an LLM prompting generator~(first time used in this task). The experimental results demonstrate that our method achieves competitive results in the few-shot setting. When trained on the full dataset, our approach outperforms all baseline methods, ranking first on the HybridQA leaderboard. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_11725 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | S$^3$HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering Lei, Fangyu Li, Xiang Wei, Yifan He, Shizhu Huang, Yiming Zhao, Jun Liu, Kang Computation and Language Answering multi-hop questions over hybrid factual knowledge from the given text and table (TextTableQA) is a challenging task. Existing models mainly adopt a retriever-reader framework, which have several deficiencies, such as noisy labeling in training retriever, insufficient utilization of heterogeneous information over text and table, and deficient ability for different reasoning operations. In this paper, we propose a three-stage TextTableQA framework S3HQA, which comprises of retriever, selector, and reasoner. We use a retriever with refinement training to solve the noisy labeling problem. Then, a hybrid selector considers the linked relationships between heterogeneous data to select the most relevant factual knowledge. For the final stage, instead of adapting a reading comprehension module like in previous methods, we employ a generation-based reasoner to obtain answers. This includes two approaches: a row-wise generator and an LLM prompting generator~(first time used in this task). The experimental results demonstrate that our method achieves competitive results in the few-shot setting. When trained on the full dataset, our approach outperforms all baseline methods, ranking first on the HybridQA leaderboard. |
| title | S$^3$HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2305.11725 |