TrustSQL: Benchmarking Text-to-SQL Reliability with Penalty-Based Scoring
Fuente:
arXiv
Saved in:
| Main Authors: | Lee, Gyubok, Chay, Woosog, Cho, Seonhee, Choi, Edward |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
SCARE: A Benchmark for SQL Correction and Question Answerability Classification for Reliable EHR Question Answering
by: Lee, Gyubok, et al.
Published: (2025)
by: Lee, Gyubok, et al.
Published: (2025)
EHR-SeqSQL : A Sequential Text-to-SQL Dataset For Interactively Exploring Electronic Health Records
by: Ryu, Jaehee, et al.
Published: (2024)
by: Ryu, Jaehee, et al.
Published: (2024)
Overview of the EHRSQL 2024 Shared Task on Reliable Text-to-SQL Modeling on Electronic Health Records
by: Lee, Gyubok, et al.
Published: (2024)
by: Lee, Gyubok, et al.
Published: (2024)
From Conversation to Query Execution: Benchmarking User and Tool Interactions for EHR Database Agents
by: Lee, Gyubok, et al.
Published: (2025)
by: Lee, Gyubok, et al.
Published: (2025)
EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Records
by: Lee, Gyubok, et al.
Published: (2023)
by: Lee, Gyubok, et al.
Published: (2023)
Reliable Text-to-SQL with Adaptive Abstention
by: Chen, Kaiwen, et al.
Published: (2025)
by: Chen, Kaiwen, et al.
Published: (2025)
DCG-SQL: Enhancing In-Context Learning for Text-to-SQL with Deep Contextual Schema Link Graph
by: Lee, Jihyung, et al.
Published: (2025)
by: Lee, Jihyung, et al.
Published: (2025)
Pervasive Annotation Errors Break Text-to-SQL Benchmarks and Leaderboards
by: Jin, Tengjun, et al.
Published: (2026)
by: Jin, Tengjun, et al.
Published: (2026)
BEAVER: An Enterprise Benchmark for Text-to-SQL
by: Chen, Peter Baile, et al.
Published: (2024)
by: Chen, Peter Baile, et al.
Published: (2024)
SQL-to-Schema Enhances Schema Linking in Text-to-SQL
by: Yang, Sun, et al.
Published: (2024)
by: Yang, Sun, et al.
Published: (2024)
GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQL
by: Chen, Daojun, et al.
Published: (2025)
by: Chen, Daojun, et al.
Published: (2025)
Evaluating LLMs for Text-to-SQL Generation With Complex SQL Workload
by: Ma, Limin, et al.
Published: (2024)
by: Ma, Limin, et al.
Published: (2024)
Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems
by: Arif, Taslim Jamal, et al.
Published: (2026)
by: Arif, Taslim Jamal, et al.
Published: (2026)
SIRIUS-SQL: Anchoring Multi-Candidate Text-to-SQL in Execution Feedback
by: Luo, Leo, et al.
Published: (2026)
by: Luo, Leo, et al.
Published: (2026)
SteinerSQL: Graph-Guided Mathematical Reasoning for Text-to-SQL Generation
by: Mao, Xutao, et al.
Published: (2025)
by: Mao, Xutao, et al.
Published: (2025)
BiomedSQL: Text-to-SQL for Scientific Reasoning on Biomedical Knowledge Bases
by: Koretsky, Mathew J., et al.
Published: (2025)
by: Koretsky, Mathew J., et al.
Published: (2025)
Rationalization Models for Text-to-SQL
by: Rossiello, Gaetano, et al.
Published: (2025)
by: Rossiello, Gaetano, et al.
Published: (2025)
DialSim: A Dialogue Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agents
by: Kim, Jiho, et al.
Published: (2024)
by: Kim, Jiho, et al.
Published: (2024)
PTD-SQL: Partitioning and Targeted Drilling with LLMs in Text-to-SQL
by: Luo, Ruilin, et al.
Published: (2024)
by: Luo, Ruilin, et al.
Published: (2024)
LLMSQL: Upgrading WikiSQL for the LLM Era of Text-to-SQL
by: Pihulski, Dzmitry, et al.
Published: (2025)
by: Pihulski, Dzmitry, et al.
Published: (2025)
APEX-SQL: Talking to the data via Agentic Exploration for Text-to-SQL
by: Cao, Bowen, et al.
Published: (2026)
by: Cao, Bowen, et al.
Published: (2026)
SQL-Trail: Multi-Turn Reinforcement Learning with Interleaved Feedback for Text-to-SQL
by: Hua, Harper, et al.
Published: (2026)
by: Hua, Harper, et al.
Published: (2026)
Beyond Text-to-SQL: Can LLMs Really Debug Enterprise ETL SQL?
by: Ye, Jing, et al.
Published: (2026)
by: Ye, Jing, et al.
Published: (2026)
ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL Dialects
by: Zhang, Jipeng, et al.
Published: (2025)
by: Zhang, Jipeng, et al.
Published: (2025)
RSL-SQL: Robust Schema Linking in Text-to-SQL Generation
by: Cao, Zhenbiao, et al.
Published: (2024)
by: Cao, Zhenbiao, et al.
Published: (2024)
Synthetic SQL Column Descriptions and Their Impact on Text-to-SQL Performance
by: Wretblad, Niklas, et al.
Published: (2024)
by: Wretblad, Niklas, et al.
Published: (2024)
PSM-SQL: Progressive Schema Learning with Multi-granularity Semantics for Text-to-SQL
by: Yang, Zhuopan, et al.
Published: (2025)
by: Yang, Zhuopan, et al.
Published: (2025)
DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL
by: Wu, Lixia, et al.
Published: (2024)
by: Wu, Lixia, et al.
Published: (2024)
MTIR-SQL: Multi-turn Tool-Integrated Reasoning Reinforcement Learning for Text-to-SQL
by: Xu, Zekun, et al.
Published: (2025)
by: Xu, Zekun, et al.
Published: (2025)
R$^3$-SQL: Ranking Reward and Resampling for Text-to-SQL
by: Han, Hojae, et al.
Published: (2026)
by: Han, Hojae, et al.
Published: (2026)
EPI-SQL: Enhancing Text-to-SQL Translation with Error-Prevention Instructions
by: Liu, Xiping, et al.
Published: (2024)
by: Liu, Xiping, et al.
Published: (2024)
EllieSQL: Cost-Efficient Text-to-SQL with Complexity-Aware Routing
by: Zhu, Yizhang, et al.
Published: (2025)
by: Zhu, Yizhang, et al.
Published: (2025)
Reasoning-SQL: Reinforcement Learning with SQL Tailored Partial Rewards for Reasoning-Enhanced Text-to-SQL
by: Pourreza, Mohammadreza, et al.
Published: (2025)
by: Pourreza, Mohammadreza, et al.
Published: (2025)
MAG-SQL: Multi-Agent Generative Approach with Soft Schema Linking and Iterative Sub-SQL Refinement for Text-to-SQL
by: Xie, Wenxuan, et al.
Published: (2024)
by: Xie, Wenxuan, et al.
Published: (2024)
SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes
by: Xie, Wenxuan, et al.
Published: (2025)
by: Xie, Wenxuan, et al.
Published: (2025)
Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQL
by: Yao, Zhewei, et al.
Published: (2025)
by: Yao, Zhewei, et al.
Published: (2025)
SelECT-SQL: Self-correcting ensemble Chain-of-Thought for Text-to-SQL
by: Shen, Ke, et al.
Published: (2024)
by: Shen, Ke, et al.
Published: (2024)
From Natural Language to SQL: Review of LLM-based Text-to-SQL Systems
by: Mohammadjafari, Ali, et al.
Published: (2024)
by: Mohammadjafari, Ali, et al.
Published: (2024)
FinStat2SQL: A Text2SQL Pipeline for Financial Statement Analysis
by: Nguyen, Quang Hung, et al.
Published: (2025)
by: Nguyen, Quang Hung, et al.
Published: (2025)
PV-SQL: Synergizing Database Probing and Rule-based Verification for Text-to-SQL Agents
by: Tian, Yuan, et al.
Published: (2026)
by: Tian, Yuan, et al.
Published: (2026)
Similar Items
-
SCARE: A Benchmark for SQL Correction and Question Answerability Classification for Reliable EHR Question Answering
by: Lee, Gyubok, et al.
Published: (2025) -
EHR-SeqSQL : A Sequential Text-to-SQL Dataset For Interactively Exploring Electronic Health Records
by: Ryu, Jaehee, et al.
Published: (2024) -
Overview of the EHRSQL 2024 Shared Task on Reliable Text-to-SQL Modeling on Electronic Health Records
by: Lee, Gyubok, et al.
Published: (2024) -
From Conversation to Query Execution: Benchmarking User and Tool Interactions for EHR Database Agents
by: Lee, Gyubok, et al.
Published: (2025) -
EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Records
by: Lee, Gyubok, et al.
Published: (2023)