Cover Image

Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhong, Qihuang, Chen, Kunfeng, Ding, Liang, Liu, Juhua, Du, Bo, Tao, Dacheng
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Databases
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Revisiting Knowledge Distillation for Autoregressive Language Models
by: Zhong, Qihuang, et al.
Published: (2024)

PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation
by: Zhong, Qihuang, et al.
Published: (2022)

Try, Check and Retry: A Divide-and-Conquer Framework for Boosting Long-context Tool-Calling Performance of LLMs
by: Chen, Kunfeng, et al.
Published: (2026)

ROSE Doesn't Do That: Boosting the Safety of Instruction-Tuned Large Language Models with Reverse Prompt Contrastive Decoding
by: Zhong, Qihuang, et al.
Published: (2024)

E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation
by: Zhong, Qihuang, et al.
Published: (2022)

Resolving Knowledge Conflicts in Domain-specific Data Selection: A Case Study on Medical Instruction-tuning
by: Zhong, Qihuang, et al.
Published: (2025)

KaFT: Knowledge-aware Fine-tuning for Boosting LLMs' Domain-specific Question-Answering Performance
by: Zhong, Qihuang, et al.
Published: (2025)

ConRAG: Consensus-Driven Multi-View Retrieval for Multi-Hop Question Answering
by: Zhu, Yikai, et al.
Published: (2026)

Text2SQL-Flow: A Robust SQL-Aware Data Augmentation Framework for Text-to-SQL
by: Cai, Qifeng, et al.
Published: (2025)

Better, Faster: Harnessing Self-Improvement in Large Reasoning Models
by: Zhong, Qihuang, et al.
Published: (2026)

Knowledge Distillation with Structured Chain-of-Thought for Text-to-SQL
by: Thaker, Khushboo, et al.
Published: (2025)

CodeS: Towards Building Open-source Language Models for Text-to-SQL
by: Li, Haoyang, et al.
Published: (2024)

AmbiSQL: Interactive Ambiguity Detection and Resolution for Text-to-SQL
by: Ding, Zhongjun, et al.
Published: (2025)

OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scale
by: Li, Haoyang, et al.
Published: (2025)

ErrorLLM: Modeling SQL Errors for Text-to-SQL Refinement
by: Hong, Zijin, et al.
Published: (2026)

Confidence Estimation for Text-to-SQL in Large Language Models
by: Maleki, Sepideh Entezari, et al.
Published: (2025)

RADAR: Benchmarking Language Models on Imperfect Tabular Data
by: Gu, Ken, et al.
Published: (2025)

Iterative Data Generation with Large Language Models for Aspect-based Sentiment Analysis
by: Zhong, Qihuang, et al.
Published: (2024)

DTS-SQL: Decomposed Text-to-SQL with Small Large Language Models
by: Pourreza, Mohammadreza, et al.
Published: (2024)

Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows
by: Lei, Fangyu, et al.
Published: (2024)

SQL-PaLM: Improved Large Language Model Adaptation for Text-to-SQL (extended)
by: Sun, Ruoxi, et al.
Published: (2023)

EllieSQL: Cost-Efficient Text-to-SQL with Complexity-Aware Routing
by: Zhu, Yizhang, et al.
Published: (2025)

Rethinking Text-to-SQL: Dynamic Multi-turn SQL Interaction for Real-world Database Exploration
by: Sun, Linzhuang, et al.
Published: (2025)

HES-SQL: Hybrid Reasoning for Efficient Text-to-SQL with Structural Skeleton Guidance
by: Qiu, Suming, et al.
Published: (2025)

Rationalization Models for Text-to-SQL
by: Rossiello, Gaetano, et al.
Published: (2025)

Analyzing the Effectiveness of Large Language Models on Text-to-SQL Synthesis
by: Roberson, Richard, et al.
Published: (2024)

ExeSQL: Self-Taught Text-to-SQL Models with Execution-Driven Bootstrapping for SQL Dialects
by: Zhang, Jipeng, et al.
Published: (2025)

GradeSQL: Test-Time Inference with Outcome Reward Models for Text-to-SQL Generation from Large Language Models
by: Tritto, Mattia, et al.
Published: (2025)

FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis
by: Zhang, Chao, et al.
Published: (2024)

FINER-SQL: Boosting Small Language Models for Text-to-SQL
by: Hoang, Thanh Dat, et al.
Published: (2026)

Dubo-SQL: Diverse Retrieval-Augmented Generation and Fine Tuning for Text-to-SQL
by: Thorpe, Dayton G., et al.
Published: (2024)

V-SQL: A View-based Two-stage Text-to-SQL Framework
by: You, Zeshun, et al.
Published: (2024)

RSL-SQL: Robust Schema Linking in Text-to-SQL Generation
by: Cao, Zhenbiao, et al.
Published: (2024)

Continual Learning of Domain Knowledge from Human Feedback in Text-to-SQL
by: Cook, Thomas, et al.
Published: (2025)

Exploring and Enhancing the Transfer of Distribution in Knowledge Distillation for Autoregressive Language Models
by: Rao, Jun, et al.
Published: (2024)

Agentar-Scale-SQL: Advancing Text-to-SQL through Orchestrated Test-Time Scaling
by: Wang, Pengfei, et al.
Published: (2025)

ORANGE: An Online Reflection ANd GEneration framework with Domain Knowledge for Text-to-SQL
by: Jiao, Yiwen, et al.
Published: (2025)

SQL-GEN: Bridging the Dialect Gap for Text-to-SQL Via Synthetic Data And Model Merging
by: Pourreza, Mohammadreza, et al.
Published: (2024)

SQLStructEval: Structural Evaluation of LLM Text-to-SQL Generation
by: Zhou, Yixi, et al.
Published: (2026)

Text-to-SQL for Enterprise Data Analytics
by: Chen, Albert, et al.
Published: (2025)