Cheaper, Better, Faster, Stronger: Robust Text-to-SQL without Chain-of-Thought or Fine-Tuning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dönder, Yusuf Denizay, Hommel, Derek, Wen-Yi, Andrea W, Mimno, David, Jo, Unso Eun Seo
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917441193377792
author Dönder, Yusuf Denizay
Hommel, Derek
Wen-Yi, Andrea W
Mimno, David
Jo, Unso Eun Seo
author_facet Dönder, Yusuf Denizay
Hommel, Derek
Wen-Yi, Andrea W
Mimno, David
Jo, Unso Eun Seo
contents LLMs are effective at code generation tasks like text-to-SQL, but is it worth the cost? Many state-of-the-art approaches use non-task-specific LLM techniques including Chain-of-Thought (CoT), self-consistency, and fine-tuning. These methods can be costly at inference time, sometimes requiring over a hundred LLM calls with reasoning, incurring average costs of up to \$0.46 per query, while fine-tuning models can cost thousands of dollars. We introduce "N-rep" consistency, a more cost-efficient text-to-SQL approach that achieves similar BIRD benchmark scores as other more expensive methods, at only \$0.039 per query. N-rep leverages multiple representations of the same schema input to mitigate weaknesses in any single representation, making the solution more robust and allowing the use of smaller and cheaper models without any reasoning or fine-tuning. To our knowledge, N-rep is the best-performing text-to-SQL approach in its cost range.
format Preprint
id arxiv_https___arxiv_org_abs_2505_14174
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Cheaper, Better, Faster, Stronger: Robust Text-to-SQL without Chain-of-Thought or Fine-Tuning
Dönder, Yusuf Denizay
Hommel, Derek
Wen-Yi, Andrea W
Mimno, David
Jo, Unso Eun Seo
Computation and Language
Machine Learning
LLMs are effective at code generation tasks like text-to-SQL, but is it worth the cost? Many state-of-the-art approaches use non-task-specific LLM techniques including Chain-of-Thought (CoT), self-consistency, and fine-tuning. These methods can be costly at inference time, sometimes requiring over a hundred LLM calls with reasoning, incurring average costs of up to \$0.46 per query, while fine-tuning models can cost thousands of dollars. We introduce "N-rep" consistency, a more cost-efficient text-to-SQL approach that achieves similar BIRD benchmark scores as other more expensive methods, at only \$0.039 per query. N-rep leverages multiple representations of the same schema input to mitigate weaknesses in any single representation, making the solution more robust and allowing the use of smaller and cheaper models without any reasoning or fine-tuning. To our knowledge, N-rep is the best-performing text-to-SQL approach in its cost range.
title Cheaper, Better, Faster, Stronger: Robust Text-to-SQL without Chain-of-Thought or Fine-Tuning
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2505.14174