SQaLe: A Large Text-to-SQL Corpus Grounded in Real Schemas

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wolff, Cornelius, Gomm, Daniel, Hulsebos, Madelon
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917294800633856
author Wolff, Cornelius
Gomm, Daniel
Hulsebos, Madelon
author_facet Wolff, Cornelius
Gomm, Daniel
Hulsebos, Madelon
contents Advances in large language models have accelerated progress in text-to-SQL, methods for converting natural language queries into valid SQL queries. A key bottleneck for developing generalizable text-to-SQL models is the lack of large-scale datasets with sufficient schema and query complexity, domain coverage, and task diversity. We introduce SQaLe: a large-scale semi-synthetic text-to-SQL dataset built on 135,875 relational database schemas expanded from a collection of real-world schemas, SchemaPile. We establish a principled generation pipeline which combines schema sampling, question synthesis, and SQL construction, and produce 517,676 high-quality (question, schema, query) triples. The SQaLe dataset captures realistic schema size variability, diverse query patterns, and natural language ambiguity while maintaining execution validity. We provide an analysis of its contents and characteristics, and find that SQaLe introduces the most realistic large-scale text-to-SQL dataset to date in comparison with existing benchmarks and datasets. We discuss how SQaLe enables our vision for data scaling and model generalization in text-to-SQL research. The dataset is accessible at: https://huggingface.co/datasets/trl-lab/SQaLe-text-to-SQL-dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2602_22223
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SQaLe: A Large Text-to-SQL Corpus Grounded in Real Schemas
Wolff, Cornelius
Gomm, Daniel
Hulsebos, Madelon
Information Retrieval
Computation and Language
Machine Learning
Advances in large language models have accelerated progress in text-to-SQL, methods for converting natural language queries into valid SQL queries. A key bottleneck for developing generalizable text-to-SQL models is the lack of large-scale datasets with sufficient schema and query complexity, domain coverage, and task diversity. We introduce SQaLe: a large-scale semi-synthetic text-to-SQL dataset built on 135,875 relational database schemas expanded from a collection of real-world schemas, SchemaPile. We establish a principled generation pipeline which combines schema sampling, question synthesis, and SQL construction, and produce 517,676 high-quality (question, schema, query) triples. The SQaLe dataset captures realistic schema size variability, diverse query patterns, and natural language ambiguity while maintaining execution validity. We provide an analysis of its contents and characteristics, and find that SQaLe introduces the most realistic large-scale text-to-SQL dataset to date in comparison with existing benchmarks and datasets. We discuss how SQaLe enables our vision for data scaling and model generalization in text-to-SQL research. The dataset is accessible at: https://huggingface.co/datasets/trl-lab/SQaLe-text-to-SQL-dataset.
title SQaLe: A Large Text-to-SQL Corpus Grounded in Real Schemas
topic Information Retrieval
Computation and Language
Machine Learning
url https://arxiv.org/abs/2602.22223