Cover Image

NL2SQL-BUGs: A Benchmark for Detecting Semantic Errors in NL2SQL Translation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Xinyu, Shen, Shuyu, Li, Boyan, Tang, Nan, Luo, Yuyu
Format:	Preprint
Published:	2025
Subjects:	Databases
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ROSE: An Intent-Centered Evaluation Metric for NL2SQL
by: Pei, Wenqi, et al.
Published: (2026)

Evaluating NL2SQL via SQL2NL
by: Safarzadeh, Mohammadtaher, et al.
Published: (2025)

EllieSQL: Cost-Efficient Text-to-SQL with Complexity-Aware Routing
by: Zhu, Yizhang, et al.
Published: (2025)

The Dawn of Natural Language to SQL: Are We Fully Ready?
by: Li, Boyan, et al.
Published: (2024)

SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarks
by: Safarzadeh, Mohammadtaher, et al.
Published: (2026)

NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions
by: Hou, Shizheng, et al.
Published: (2026)

TailorSQL: An NL2SQL System Tailored to Your Query Workload
by: Vaidya, Kapil, et al.
Published: (2025)

Dial: A Knowledge-Grounded Dialect-Specific NL2SQL System
by: Zhang, Xiang, et al.
Published: (2026)

Effectiveness of Prompt Optimization in NL2SQL Systems
by: Gurajada, Sairam, et al.
Published: (2025)

A Survey of Text-to-SQL in the Era of LLMs: Where are we, and where are we going?
by: Liu, Xinyu, et al.
Published: (2024)

Alpha-SQL: Zero-Shot Text-to-SQL using Monte Carlo Tree Search
by: Li, Boyan, et al.
Published: (2025)

DeepEye-SQL: A Software-Engineering-Inspired Text-to-SQL Framework
by: Li, Boyan, et al.
Published: (2025)

An Agentic System for Schema Aware NL2SQL Generation
by: Onyango, David, et al.
Published: (2026)

A Plug-and-Play Natural Language Rewriter for Natural Language to SQL
by: Ma, Peixian, et al.
Published: (2024)

ODIN: A NL2SQL Recommender to Handle Schema Ambiguity
by: Vaidya, Kapil, et al.
Published: (2025)

VeriMinder: Mitigating Analytical Vulnerabilities in NL2SQL
by: Mohole, Shubham, et al.
Published: (2025)

SQL-Encoder: Improving NL2SQL In-Context Learning Through a Context-Aware Encoder
by: Pourreza, Mohammadreza, et al.
Published: (2024)

Feather-SQL: A Lightweight NL2SQL Framework with Dual-Model Collaboration Paradigm for Small Language Models
by: Pei, Wenqi, et al.
Published: (2025)

GeoSQL-Eval: First Evaluation of LLMs on PostGIS-Based NL2GeoSQL Queries
by: Hou, Shuyang, et al.
Published: (2025)

Data-aware candidate selection in NL2SQL translation via small separating instances
by: Kikot, Stanislav, et al.
Published: (2026)

DePLOI: Applying NL2SQL to Synthesize and Audit Database Access Control
by: Subramaniam, Pranav, et al.
Published: (2024)

RubikSQL: Lifelong Learning Agentic Knowledge Base as an Industrial NL2SQL System
by: Chen, Zui, et al.
Published: (2025)

Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQL
by: Chung, Yeounoh, et al.
Published: (2025)

DPC: Training-Free Text-to-SQL Candidate Selection via Dual-Paradigm Consistency
by: Li, Boyan, et al.
Published: (2026)

EPI-SQL: Enhancing Text-to-SQL Translation with Error-Prevention Instructions
by: Liu, Xiping, et al.
Published: (2024)

SEA-SQL: Semantic-Enhanced Text-to-SQL with Adaptive Refinement
by: Li, Chaofan, et al.
Published: (2024)

FD-NL2SQL: Feedback-Driven Clinical NL2SQL that Improves with Use
by: Chowdhury, Suparno Roy, et al.
Published: (2026)

ErrorLLM: Modeling SQL Errors for Text-to-SQL Refinement
by: Hong, Zijin, et al.
Published: (2026)

$R^3$-NL2GQL: A Model Coordination and Knowledge Graph Alignment Approach for NL2GQL
by: Zhou, Yuhang, et al.
Published: (2023)

Semantic SQL -- Combining and optimizing semantic predicates in SQL
by: Mittal, Akash, et al.
Published: (2024)

Blar-SQL: Faster, Stronger, Smaller NL2SQL
by: Domínguez, José Manuel, et al.
Published: (2024)

Understanding the Semantic SQL Transducer
by: Abgrall, Théo, et al.
Published: (2024)

SQL-of-Thought: Multi-agentic Text-to-SQL with Guided Error Correction
by: Chaturvedi, Saumya, et al.
Published: (2025)

PSM-SQL: Progressive Schema Learning with Multi-granularity Semantics for Text-to-SQL
by: Yang, Zhuopan, et al.
Published: (2025)

Pervasive Annotation Errors Break Text-to-SQL Benchmarks and Leaderboards
by: Jin, Tengjun, et al.
Published: (2026)

MCI-SQL: Text-to-SQL with Metadata-Complete Context and Intermediate Correction
by: Wang, Qin, et al.
Published: (2026)

iPDB -- Optimizing Semantic SQL Queries
by: Kumarasinghe, Udesh, et al.
Published: (2026)

SING-SQL: A Synthetic Data Generation Framework for In-Domain Text-to-SQL Translation
by: Caferoğlu, Hasan Alp, et al.
Published: (2025)

BIS: NL2SQL Service Evaluation Benchmark for Business Intelligence Scenarios
by: Caglayan, Bora, et al.
Published: (2024)

Text2SQL-Flow: A Robust SQL-Aware Data Augmentation Framework for Text-to-SQL
by: Cai, Qifeng, et al.
Published: (2025)