SQL-Trail: Multi-Turn Reinforcement Learning with Interleaved Feedback for Text-to-SQL

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hua, Harper, Han, Zhen, Shen, Zhengyuan, Lee, Jeremy, Guan, Patrick, Zhu, Qi, Jeoung, Sullam, Chen, Yueyan, Bai, Yunfei, Wang, Shuai, Ioannidis, Vassilis, Rangwala, Huzefa
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908786392825856
author Hua, Harper
Han, Zhen
Shen, Zhengyuan
Lee, Jeremy
Guan, Patrick
Zhu, Qi
Jeoung, Sullam
Chen, Yueyan
Bai, Yunfei
Wang, Shuai
Ioannidis, Vassilis
Rangwala, Huzefa
author_facet Hua, Harper
Han, Zhen
Shen, Zhengyuan
Lee, Jeremy
Guan, Patrick
Zhu, Qi
Jeoung, Sullam
Chen, Yueyan
Bai, Yunfei
Wang, Shuai
Ioannidis, Vassilis
Rangwala, Huzefa
contents While large language models (LLMs) have substantially improved Text-to-SQL generation, a pronounced gap remains between AI systems and human experts on challenging benchmarks such as BIRD-SQL. We argue this gap stems largely from the prevailing single-pass paradigm, which lacks the iterative reasoning, schema exploration, and error-correction behaviors that humans naturally employ. To address this limitation, we introduce SQL-Trail, a multi-turn reinforcement learning (RL) agentic framework for Text-to-SQL. Rather than producing a query in one shot, SQL-Trail interacts with the database environment and uses execution feedback to iteratively refine its predictions. Our approach centers on two key ideas: (i) an adaptive turn-budget allocation mechanism that scales the agent's interaction depth to match question difficulty, and (ii) a composite reward panel that jointly incentivizes SQL correctness and efficient exploration. Across benchmarks, SQL-Trail sets a new state of the art and delivers strong data efficiency--up to 18x higher than prior single-pass RL state-of-the-art methods. Notably, our 7B and 14B models outperform substantially larger proprietary systems by 5% on average, underscoring the effectiveness of interactive, agentic workflows for robust Text-to-SQL generation.
format Preprint
id arxiv_https___arxiv_org_abs_2601_17699
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SQL-Trail: Multi-Turn Reinforcement Learning with Interleaved Feedback for Text-to-SQL
Hua, Harper
Han, Zhen
Shen, Zhengyuan
Lee, Jeremy
Guan, Patrick
Zhu, Qi
Jeoung, Sullam
Chen, Yueyan
Bai, Yunfei
Wang, Shuai
Ioannidis, Vassilis
Rangwala, Huzefa
Artificial Intelligence
Computation and Language
While large language models (LLMs) have substantially improved Text-to-SQL generation, a pronounced gap remains between AI systems and human experts on challenging benchmarks such as BIRD-SQL. We argue this gap stems largely from the prevailing single-pass paradigm, which lacks the iterative reasoning, schema exploration, and error-correction behaviors that humans naturally employ. To address this limitation, we introduce SQL-Trail, a multi-turn reinforcement learning (RL) agentic framework for Text-to-SQL. Rather than producing a query in one shot, SQL-Trail interacts with the database environment and uses execution feedback to iteratively refine its predictions. Our approach centers on two key ideas: (i) an adaptive turn-budget allocation mechanism that scales the agent's interaction depth to match question difficulty, and (ii) a composite reward panel that jointly incentivizes SQL correctness and efficient exploration. Across benchmarks, SQL-Trail sets a new state of the art and delivers strong data efficiency--up to 18x higher than prior single-pass RL state-of-the-art methods. Notably, our 7B and 14B models outperform substantially larger proprietary systems by 5% on average, underscoring the effectiveness of interactive, agentic workflows for robust Text-to-SQL generation.
title SQL-Trail: Multi-Turn Reinforcement Learning with Interleaved Feedback for Text-to-SQL
topic Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2601.17699