Cover Image

SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Safarzadeh, Mohammadtaher, Patel, Hitesh Laxmichand, Orojlooyjadid, Afshin, Horwood, Graham, Roth, Dan
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence Databases
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Evaluating NL2SQL via SQL2NL
by: Safarzadeh, Mohammadtaher, et al.
Published: (2025)

NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions
by: Hou, Shizheng, et al.
Published: (2026)

VeriMinder: Mitigating Analytical Vulnerabilities in NL2SQL
by: Mohole, Shubham, et al.
Published: (2025)

Feather-SQL: A Lightweight NL2SQL Framework with Dual-Model Collaboration Paradigm for Small Language Models
by: Pei, Wenqi, et al.
Published: (2025)

BEAVER: An Enterprise Benchmark for Text-to-SQL
by: Chen, Peter Baile, et al.
Published: (2024)

AccessEval: Benchmarking Disability Bias in Large Language Models
by: Panda, Srikant, et al.
Published: (2025)

H-STAR: LLM-driven Hybrid SQL-Text Adaptive Reasoning on Tables
by: Abhyankar, Nikhil, et al.
Published: (2024)

Dial: A Knowledge-Grounded Dialect-Specific NL2SQL System
by: Zhang, Xiang, et al.
Published: (2026)

GSM-SEM: Benchmark and Framework for Generating Semantically Variant Augmentations
by: Singh, Jyotika, et al.
Published: (2026)

NL2KQL: From Natural Language to Kusto Query
by: Tang, Xinye, et al.
Published: (2024)

IndicDB -- Benchmarking Multilingual Text-to-SQL Capabilities in Indian Languages
by: Dawar, Aviral, et al.
Published: (2026)

Query Carefully: Detecting the Unanswerables in Text-to-SQL Tasks
by: Saxer, Jasmin, et al.
Published: (2025)

ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL Dialects
by: Zhang, Jipeng, et al.
Published: (2025)

SQL-Exchange: Transforming SQL Queries Across Domains
by: Daviran, Mohammadreza, et al.
Published: (2025)

RSL-SQL: Robust Schema Linking in Text-to-SQL Generation
by: Cao, Zhenbiao, et al.
Published: (2024)

Synthetic SQL Column Descriptions and Their Impact on Text-to-SQL Performance
by: Wretblad, Niklas, et al.
Published: (2024)

OraPlan-SQL: A Planning-Centric Framework for Complex Bilingual NL2SQL Reasoning
by: Liu, Marianne Menglin, et al.
Published: (2025)

Tokenization Matters: Improving Zero-Shot NER for Indic Languages
by: Pattnayak, Priyaranjan, et al.
Published: (2025)

EllieSQL: Cost-Efficient Text-to-SQL with Complexity-Aware Routing
by: Zhu, Yizhang, et al.
Published: (2025)

EPI-SQL: Enhancing Text-to-SQL Translation with Error-Prevention Instructions
by: Liu, Xiping, et al.
Published: (2024)

Aligning Large Language Models to a Domain-specific Graph Database for NL2GQL
by: Liang, Yuanyuan, et al.
Published: (2024)

HES-SQL: Hybrid Reasoning for Efficient Text-to-SQL with Structural Skeleton Guidance
by: Qiu, Suming, et al.
Published: (2025)

SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)
by: Sun, Ruoxi, et al.
Published: (2023)

FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis
by: Zhang, Chao, et al.
Published: (2024)

Rationalization Models for Text-to-SQL
by: Rossiello, Gaetano, et al.
Published: (2025)

When Vision-Language Models Judge Without Seeing: Exposing Informativeness Bias
by: Zou, Xiaohan, et al.
Published: (2026)

LLM NL2SQL Robustness: Surface Noise vs. Linguistic Variation in Traditional and Agentic Settings
by: Tu, Lifu, et al.
Published: (2026)

Extractive Schema Linking for Text-to-SQL
by: Glass, Michael, et al.
Published: (2025)

NAT-NL2GQL: A Novel Multi-Agent Framework for Translating Natural Language to Graph Query Language
by: Liang, Yuanyuan, et al.
Published: (2024)

SchemaGraphSQL: Efficient Schema Linking with Pathfinding Graph Algorithms for Text-to-SQL on Large-Scale Databases
by: Safdarian, AmirHossein, et al.
Published: (2025)

TailorSQL: An NL2SQL System Tailored to Your Query Workload
by: Vaidya, Kapil, et al.
Published: (2025)

$R^3$: "This is My SQL, Are You With Me?" A Consensus-Based Multi-Agent System for Text-to-SQL Tasks
by: Xia, Hanchen, et al.
Published: (2024)

GradeSQL: Test-Time Inference with Outcome Reward Models for Text-to-SQL Generation from Large Language Models
by: Tritto, Mattia, et al.
Published: (2025)

Effectiveness of Prompt Optimization in NL2SQL Systems
by: Gurajada, Sairam, et al.
Published: (2025)

BAPPA: Benchmarking Agents, Plans, and Pipelines for Automated Text-to-SQL Generation
by: Ahmed, Fahim, et al.
Published: (2025)

Structure Guided Large Language Model for SQL Generation
by: Zhang, Qinggang, et al.
Published: (2024)

BIRDTurk: Adaptation of the BIRD Text-to-SQL Dataset to Turkish
by: Aktaş, Burak, et al.
Published: (2026)

Knowledge Distillation with Structured Chain-of-Thought for Text-to-SQL
by: Thaker, Khushboo, et al.
Published: (2025)

ROSE: An Intent-Centered Evaluation Metric for NL2SQL
by: Pei, Wenqi, et al.
Published: (2026)

MCTS-SQL: Light-Weight LLMs can Master the Text-to-SQL through Monte Carlo Tree Search
by: Yuan, Shuozhi, et al.
Published: (2025)