Saved in:
Bibliographic Details
Main Authors: Yi, Deyin, Liu, Yihao, Cao, Lang, Zhou, Mengyu, Dong, Haoyu, Han, Shi, Zhang, Dongmei
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2503.13262
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916667578122240
author Yi, Deyin
Liu, Yihao
Cao, Lang
Zhou, Mengyu
Dong, Haoyu
Han, Shi
Zhang, Dongmei
author_facet Yi, Deyin
Liu, Yihao
Cao, Lang
Zhou, Mengyu
Dong, Haoyu
Han, Shi
Zhang, Dongmei
contents Tabular data analysis is crucial in many scenarios, yet efficiently identifying the most relevant data analysis queries and results for a new table remains a significant challenge. The complexity of tabular data, diverse analytical operations, and the demand for high-quality analysis make the process tedious. To address these challenges, we aim to recommend query-code-result triplets tailored for new tables in tabular data analysis workflows. In this paper, we present TablePilot, a pioneering tabular data analysis framework leveraging large language models to autonomously generate comprehensive and superior analytical results without relying on user profiles or prior interactions. The framework incorporates key designs in analysis preparation and analysis optimization to enhance accuracy. Additionally, we propose Rec-Align, a novel method to further improve recommendation quality and better align with human preferences. Experiments on DART, a dataset specifically designed for comprehensive tabular data analysis recommendation, demonstrate the effectiveness of our framework. Based on GPT-4o, the tuned TablePilot achieves 77.0% top-5 recommendation recall. Human evaluations further highlight its effectiveness in optimizing tabular data analysis workflows.
format Preprint
id arxiv_https___arxiv_org_abs_2503_13262
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TablePilot: Recommending Human-Preferred Tabular Data Analysis with Large Language Models
Yi, Deyin
Liu, Yihao
Cao, Lang
Zhou, Mengyu
Dong, Haoyu
Han, Shi
Zhang, Dongmei
Computation and Language
Tabular data analysis is crucial in many scenarios, yet efficiently identifying the most relevant data analysis queries and results for a new table remains a significant challenge. The complexity of tabular data, diverse analytical operations, and the demand for high-quality analysis make the process tedious. To address these challenges, we aim to recommend query-code-result triplets tailored for new tables in tabular data analysis workflows. In this paper, we present TablePilot, a pioneering tabular data analysis framework leveraging large language models to autonomously generate comprehensive and superior analytical results without relying on user profiles or prior interactions. The framework incorporates key designs in analysis preparation and analysis optimization to enhance accuracy. Additionally, we propose Rec-Align, a novel method to further improve recommendation quality and better align with human preferences. Experiments on DART, a dataset specifically designed for comprehensive tabular data analysis recommendation, demonstrate the effectiveness of our framework. Based on GPT-4o, the tuned TablePilot achieves 77.0% top-5 recommendation recall. Human evaluations further highlight its effectiveness in optimizing tabular data analysis workflows.
title TablePilot: Recommending Human-Preferred Tabular Data Analysis with Large Language Models
topic Computation and Language
url https://arxiv.org/abs/2503.13262