NL2SQLBench: A Modular Benchmarking Framework for LLM-Enabled NL2SQL Solutions
Fuente:
arXiv
Saved in:
| Main Authors: | Hou, Shizheng, Pei, Wenqi, Chen, Nuo, Ta, Quang-Trung, Lu, Peng, Ooi, Beng Chin |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Feather-SQL: A Lightweight NL2SQL Framework with Dual-Model Collaboration Paradigm for Small Language Models
by: Pei, Wenqi, et al.
Published: (2025)
by: Pei, Wenqi, et al.
Published: (2025)
ROSE: An Intent-Centered Evaluation Metric for NL2SQL
by: Pei, Wenqi, et al.
Published: (2026)
by: Pei, Wenqi, et al.
Published: (2026)
Evaluating NL2SQL via SQL2NL
by: Safarzadeh, Mohammadtaher, et al.
Published: (2025)
by: Safarzadeh, Mohammadtaher, et al.
Published: (2025)
Effectiveness of Prompt Optimization in NL2SQL Systems
by: Gurajada, Sairam, et al.
Published: (2025)
by: Gurajada, Sairam, et al.
Published: (2025)
TailorSQL: An NL2SQL System Tailored to Your Query Workload
by: Vaidya, Kapil, et al.
Published: (2025)
by: Vaidya, Kapil, et al.
Published: (2025)
NL2SQL-BUGs: A Benchmark for Detecting Semantic Errors in NL2SQL Translation
by: Liu, Xinyu, et al.
Published: (2025)
by: Liu, Xinyu, et al.
Published: (2025)
An Agentic System for Schema Aware NL2SQL Generation
by: Onyango, David, et al.
Published: (2026)
by: Onyango, David, et al.
Published: (2026)
SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarks
by: Safarzadeh, Mohammadtaher, et al.
Published: (2026)
by: Safarzadeh, Mohammadtaher, et al.
Published: (2026)
ODIN: A NL2SQL Recommender to Handle Schema Ambiguity
by: Vaidya, Kapil, et al.
Published: (2025)
by: Vaidya, Kapil, et al.
Published: (2025)
VeriMinder: Mitigating Analytical Vulnerabilities in NL2SQL
by: Mohole, Shubham, et al.
Published: (2025)
by: Mohole, Shubham, et al.
Published: (2025)
$R^3$-NL2GQL: A Model Coordination and Knowledge Graph Alignment Approach for NL2GQL
by: Zhou, Yuhang, et al.
Published: (2023)
by: Zhou, Yuhang, et al.
Published: (2023)
SQL-Encoder: Improving NL2SQL In-Context Learning Through a Context-Aware Encoder
by: Pourreza, Mohammadreza, et al.
Published: (2024)
by: Pourreza, Mohammadreza, et al.
Published: (2024)
Dial: A Knowledge-Grounded Dialect-Specific NL2SQL System
by: Zhang, Xiang, et al.
Published: (2026)
by: Zhang, Xiang, et al.
Published: (2026)
NL2KQL: From Natural Language to Kusto Query
by: Tang, Xinye, et al.
Published: (2024)
by: Tang, Xinye, et al.
Published: (2024)
RubikSQL: Lifelong Learning Agentic Knowledge Base as an Industrial NL2SQL System
by: Chen, Zui, et al.
Published: (2025)
by: Chen, Zui, et al.
Published: (2025)
NAT-NL2GQL: A Novel Multi-Agent Framework for Translating Natural Language to Graph Query Language
by: Liang, Yuanyuan, et al.
Published: (2024)
by: Liang, Yuanyuan, et al.
Published: (2024)
Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQL
by: Chung, Yeounoh, et al.
Published: (2025)
by: Chung, Yeounoh, et al.
Published: (2025)
FD-NL2SQL: Feedback-Driven Clinical NL2SQL that Improves with Use
by: Chowdhury, Suparno Roy, et al.
Published: (2026)
by: Chowdhury, Suparno Roy, et al.
Published: (2026)
Data-aware candidate selection in NL2SQL translation via small separating instances
by: Kikot, Stanislav, et al.
Published: (2026)
by: Kikot, Stanislav, et al.
Published: (2026)
GeoSQL-Eval: First Evaluation of LLMs on PostGIS-Based NL2GeoSQL Queries
by: Hou, Shuyang, et al.
Published: (2025)
by: Hou, Shuyang, et al.
Published: (2025)
DePLOI: Applying NL2SQL to Synthesize and Audit Database Access Control
by: Subramaniam, Pranav, et al.
Published: (2024)
by: Subramaniam, Pranav, et al.
Published: (2024)
Aligning Large Language Models to a Domain-specific Graph Database for NL2GQL
by: Liang, Yuanyuan, et al.
Published: (2024)
by: Liang, Yuanyuan, et al.
Published: (2024)
Q-NL Verifier: Leveraging Synthetic Data for Robust Knowledge Graph Question Answering
by: Schwabe, Tim, et al.
Published: (2025)
by: Schwabe, Tim, et al.
Published: (2025)
Blar-SQL: Faster, Stronger, Smaller NL2SQL
by: Domínguez, José Manuel, et al.
Published: (2024)
by: Domínguez, José Manuel, et al.
Published: (2024)
Text2SQL-Flow: A Robust SQL-Aware Data Augmentation Framework for Text-to-SQL
by: Cai, Qifeng, et al.
Published: (2025)
by: Cai, Qifeng, et al.
Published: (2025)
CLARITY: A Framework and Benchmark for Conversational Language Ambiguity and Unanswerability in Interactive NL2SQL Systems
by: Sarwar, Tabinda, et al.
Published: (2026)
by: Sarwar, Tabinda, et al.
Published: (2026)
V-SQL: A View-based Two-stage Text-to-SQL Framework
by: You, Zeshun, et al.
Published: (2024)
by: You, Zeshun, et al.
Published: (2024)
NeurIDA: Dynamic Modeling for Effective In-Database Analytics
by: Zeng, Lingze, et al.
Published: (2025)
by: Zeng, Lingze, et al.
Published: (2025)
LLM-SQL-Solver: Can LLMs Determine SQL Equivalence?
by: Zhao, Fuheng, et al.
Published: (2023)
by: Zhao, Fuheng, et al.
Published: (2023)
ErrorLLM: Modeling SQL Errors for Text-to-SQL Refinement
by: Hong, Zijin, et al.
Published: (2026)
by: Hong, Zijin, et al.
Published: (2026)
EGREFINE: An Execution-Grounded Optimization Framework for Text-to-SQL Schema Refinement
by: Wang, Jiaqian, et al.
Published: (2026)
by: Wang, Jiaqian, et al.
Published: (2026)
OraPlan-SQL: A Planning-Centric Framework for Complex Bilingual NL2SQL Reasoning
by: Liu, Marianne Menglin, et al.
Published: (2025)
by: Liu, Marianne Menglin, et al.
Published: (2025)
MTEB-NL and E5-NL: Embedding Benchmark and Models for Dutch
by: Banar, Nikolay, et al.
Published: (2025)
by: Banar, Nikolay, et al.
Published: (2025)
Hybrid-NL2SVA: Integrating RAG and Finetuning for LLM-based NL2SVA
by: Xiao, Weihua, et al.
Published: (2025)
by: Xiao, Weihua, et al.
Published: (2025)
SQLong: Enhanced NL2SQL for Longer Contexts with LLMs
by: Nguyen, Dai Quoc, et al.
Published: (2025)
by: Nguyen, Dai Quoc, et al.
Published: (2025)
FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis
by: Zhang, Chao, et al.
Published: (2024)
by: Zhang, Chao, et al.
Published: (2024)
Memory in the LLM Era: Modular Architectures and Strategies in a Unified Framework
by: Wu, Yanchen, et al.
Published: (2026)
by: Wu, Yanchen, et al.
Published: (2026)
BEAVER: An Enterprise Benchmark for Text-to-SQL
by: Chen, Peter Baile, et al.
Published: (2024)
by: Chen, Peter Baile, et al.
Published: (2024)
SQLStructEval: Structural Evaluation of LLM Text-to-SQL Generation
by: Zhou, Yixi, et al.
Published: (2026)
by: Zhou, Yixi, et al.
Published: (2026)
Agentar-Scale-SQL: Advancing Text-to-SQL through Orchestrated Test-Time Scaling
by: Wang, Pengfei, et al.
Published: (2025)
by: Wang, Pengfei, et al.
Published: (2025)
Similar Items
-
Feather-SQL: A Lightweight NL2SQL Framework with Dual-Model Collaboration Paradigm for Small Language Models
by: Pei, Wenqi, et al.
Published: (2025) -
ROSE: An Intent-Centered Evaluation Metric for NL2SQL
by: Pei, Wenqi, et al.
Published: (2026) -
Evaluating NL2SQL via SQL2NL
by: Safarzadeh, Mohammadtaher, et al.
Published: (2025) -
Effectiveness of Prompt Optimization in NL2SQL Systems
by: Gurajada, Sairam, et al.
Published: (2025) -
TailorSQL: An NL2SQL System Tailored to Your Query Workload
by: Vaidya, Kapil, et al.
Published: (2025)