H-STAR: LLM-driven Hybrid SQL-Text Adaptive Reasoning on Tables

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Abhyankar, Nikhil, Gupta, Vivek, Roth, Dan, Reddy, Chandan K.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915230519394304
author Abhyankar, Nikhil
Gupta, Vivek
Roth, Dan
Reddy, Chandan K.
author_facet Abhyankar, Nikhil
Gupta, Vivek
Roth, Dan
Reddy, Chandan K.
contents Tabular reasoning involves interpreting natural language queries about tabular data, which presents a unique challenge of combining language understanding with structured data analysis. Existing methods employ either textual reasoning, which excels in semantic interpretation but struggles with mathematical operations, or symbolic reasoning, which handles computations well but lacks semantic understanding. This paper introduces a novel algorithm H-STAR that integrates both symbolic and semantic (textual) approaches in a two-stage process to address these limitations. H-STAR employs: (1) step-wise table extraction using `multi-view' column retrieval followed by row extraction, and (2) adaptive reasoning that adapts reasoning strategies based on question types, utilizing semantic reasoning for direct lookup and complex lexical queries while augmenting textual reasoning with symbolic reasoning support for quantitative and logical tasks. Our extensive experiments demonstrate that H-STAR significantly outperforms state-of-the-art methods across three tabular question-answering (QA) and fact-verification datasets, underscoring its effectiveness and efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2407_05952
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle H-STAR: LLM-driven Hybrid SQL-Text Adaptive Reasoning on Tables
Abhyankar, Nikhil
Gupta, Vivek
Roth, Dan
Reddy, Chandan K.
Databases
Artificial Intelligence
Computation and Language
Machine Learning
Tabular reasoning involves interpreting natural language queries about tabular data, which presents a unique challenge of combining language understanding with structured data analysis. Existing methods employ either textual reasoning, which excels in semantic interpretation but struggles with mathematical operations, or symbolic reasoning, which handles computations well but lacks semantic understanding. This paper introduces a novel algorithm H-STAR that integrates both symbolic and semantic (textual) approaches in a two-stage process to address these limitations. H-STAR employs: (1) step-wise table extraction using `multi-view' column retrieval followed by row extraction, and (2) adaptive reasoning that adapts reasoning strategies based on question types, utilizing semantic reasoning for direct lookup and complex lexical queries while augmenting textual reasoning with symbolic reasoning support for quantitative and logical tasks. Our extensive experiments demonstrate that H-STAR significantly outperforms state-of-the-art methods across three tabular question-answering (QA) and fact-verification datasets, underscoring its effectiveness and efficiency.
title H-STAR: LLM-driven Hybrid SQL-Text Adaptive Reasoning on Tables
topic Databases
Artificial Intelligence
Computation and Language
Machine Learning
url https://arxiv.org/abs/2407.05952