Cover Image

PARROT: A Benchmark for Evaluating LLMs in Cross-System SQL Translation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhou, Wei, Li, Guoliang, Wang, Haoyu, Han, Yuxing, Wu, Xufei, Wu, Fan, Zhou, Xuanhe
Format:	Preprint
Published:	2025
Subjects:	Databases Artificial Intelligence Computation and Language Information Retrieval Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CrackSQL: A Hybrid SQL Dialect Translation System Powered by Large Language Models
by: Zhou, Wei, et al.
Published: (2025)

Dial: A Knowledge-Grounded Dialect-Specific NL2SQL System
by: Zhang, Xiang, et al.
Published: (2026)

DBAIOps: A Reasoning LLM-Enhanced Database Operation and Maintenance System using Knowledge Graphs
by: Zhou, Wei, et al.
Published: (2025)

GaussMaster: An LLM-based Database Copilot System
by: Zhou, Wei, et al.
Published: (2025)

Automating Database-Native Function Code Synthesis with LLMs
by: Zhou, Wei, et al.
Published: (2026)

MoDora: Tree-Based Semi-Structured Document Analysis System
by: Xu, Bangrui, et al.
Published: (2026)

A Survey of LLM $\times$ DATA
by: Zhou, Xuanhe, et al.
Published: (2025)

ST-Raptor: LLM-Powered Semi-Structured Table Question Answering
by: Tang, Zirui, et al.
Published: (2025)

AraSpider: Democratizing Arabic-to-SQL
by: Heakl, Ahmed, et al.
Published: (2024)

Text-to-SQL Oriented to the Process Mining Domain: A PT-EN Dataset for Query Translation
by: Yamate, Bruno Yui, et al.
Published: (2025)

KeyInst: Keyword Instruction for Improving SQL Formulation in Text-to-SQL
by: Liu, Xiping, et al.
Published: (2024)

EHR-SeqSQL : A Sequential Text-to-SQL Dataset For Interactively Exploring Electronic Health Records
by: Ryu, Jaehee, et al.
Published: (2024)

LR-SQL: A Supervised Fine-Tuning Method for Text2SQL Tasks under Low-Resource Scenarios
by: Wuzhenghong, Wen, et al.
Published: (2024)

Text-to-SQL Task-oriented Dialogue Ontology Construction
by: Vukovic, Renato, et al.
Published: (2025)

OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs
by: Zhang, Jintian, et al.
Published: (2024)

Multilingual Text-to-SQL: Benchmarking the Limits of Language Models with Collaborative Language Agents
by: Pham, Khanh Trinh, et al.
Published: (2025)

KU-DMIS at EHRSQL 2024:Generating SQL query via question templatization in EHR
by: Kim, Hajung, et al.
Published: (2024)

Reliable Answers for Recurring Questions: Boosting Text-to-SQL Accuracy with Template Constrained Decoding
by: Jivani, Smit, et al.
Published: (2026)

OneKE: A Dockerized Schema-Guided LLM Agent-based Knowledge Extraction System
by: Luo, Yujie, et al.
Published: (2024)

DSL-R1: From SQL to DSL for Training Retrieval Agents across Structured and Unstructured Data with Reinforcement Learning
by: Hu, Yunhai, et al.
Published: (2026)

OneEdit: A Neural-Symbolic Collaboratively Knowledge Editing System
by: Zhang, Ningyu, et al.
Published: (2024)

LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities
by: Zhu, Yuqi, et al.
Published: (2023)

Balancing Content Size in RAG-Text2SQL System
by: Gurawa, Prakhar, et al.
Published: (2025)

StructText: A Synthetic Table-to-Text Approach for Benchmark Generation with Multi-Dimensional Evaluation
by: Kashyap, Satyananda, et al.
Published: (2025)

RUST-BENCH: Benchmarking LLM Reasoning on Unstructured Text within Structured Tables
by: Abhyankar, Nikhil, et al.
Published: (2025)

SAGE: A Framework of Precise Retrieval for RAG
by: Zhang, Jintao, et al.
Published: (2025)

QDA-SQL: Questions Enhanced Dialogue Augmentation for Multi-Turn Text-to-SQL
by: Sun, Yinggang, et al.
Published: (2024)

Something's Fishy In The Data Lake: A Critical Re-evaluation of Table Union Search Benchmarks
by: Boutaleb, Allaa, et al.
Published: (2025)

LLM-Enhanced Data Management
by: Zhou, Xuanhe, et al.
Published: (2024)

TARGET: Benchmarking Table Retrieval for Generative Tasks
by: Ji, Xingyu, et al.
Published: (2025)

An In-Depth Study of Filter-Agnostic Vector Search on a PostgreSQL Database System: [Experiments and Analysis]
by: Lu, Duo, et al.
Published: (2026)

Taxonomy Inference for Tabular Data Using Large Language Models
by: Wu, Zhenyu, et al.
Published: (2025)

NormTab: Improving Symbolic Reasoning in LLMs Through Tabular Data Normalization
by: Nahid, Md Mahadi Hasan, et al.
Published: (2024)

Text-to-SQL Calibration: No Need to Ask -- Just Rescale Model Probabilities
by: Ramachandran, Ashwin, et al.
Published: (2024)

From Questions to Queries: An AI-powered Multi-Agent Framework for Spatial Text-to-SQL
by: Kazazi, Ali Khosravi, et al.
Published: (2025)

GRAM: Generative Retrieval Augmented Matching of Data Schemas in the Context of Data Security
by: Liu, Xuanqing, et al.
Published: (2024)

Exploring Multi-Table Retrieval Through Iterative Search
by: Boutaleb, Allaa, et al.
Published: (2025)

IEPile: Unearthing Large-Scale Schema-Based Information Extraction Corpus
by: Gui, Honghao, et al.
Published: (2024)

Editing Conceptual Knowledge for Large Language Models
by: Wang, Xiaohan, et al.
Published: (2024)

Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMs
by: Zhou, Wei, et al.
Published: (2026)