Querying Structured Data Through Natural Language Using Language Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Valentin-Micu, Hontan, Andrei-Alexandru, Bunea, Dimitrios, Tantaroudas Nikolaos, Dan-Matei, Popovici
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910100435763200
author Valentin-Micu, Hontan
Andrei-Alexandru, Bunea
Dimitrios, Tantaroudas Nikolaos
Dan-Matei, Popovici
author_facet Valentin-Micu, Hontan
Andrei-Alexandru, Bunea
Dimitrios, Tantaroudas Nikolaos
Dan-Matei, Popovici
contents This paper presents an open source methodology for allowing users to query structured non textual datasets through natural language Unlike Retrieval Augmented Generation RAG which struggles with numerical and highly structured information our approach trains an LLM to generate executable queries To support this capability we introduce a principled pipeline for synthetic training data generation producing diverse question answer pairs that capture both user intent and the semantics of the underlying dataset We fine tune a compact model DeepSeek R1 Distill 8B using QLoRA with 4 bit quantization making the system suitable for deployment on commodity hardware We evaluate our approach on a dataset describing accessibility to essential services across Durangaldea Spain The fine tuned model achieves high accuracy across monolingual multilingual and unseen location scenarios demonstrating both robust generalization and reliable query generation Our results highlight that small domain specific models can achieve high precision for this task without relying on large proprietary LLMs making this methodology suitable for resource constrained environments and adaptable to broader multi dataset systems We evaluate our approach on a dataset describing accessibility to essential services across Durangaldea Spain The fine tuned model achieves high accuracy across monolingual multilingual and unseen location scenarios demonstrating both robust generalization and reliable query generation Our results highlight that small domain specific models can achieve high precision for this task without relying on large proprietary LLMs making this methodology suitable for resource constrained environments and adaptable to broader multi dataset systems.
format Preprint
id arxiv_https___arxiv_org_abs_2604_03057
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Querying Structured Data Through Natural Language Using Language Models
Valentin-Micu, Hontan
Andrei-Alexandru, Bunea
Dimitrios, Tantaroudas Nikolaos
Dan-Matei, Popovici
Computation and Language
Artificial Intelligence
This paper presents an open source methodology for allowing users to query structured non textual datasets through natural language Unlike Retrieval Augmented Generation RAG which struggles with numerical and highly structured information our approach trains an LLM to generate executable queries To support this capability we introduce a principled pipeline for synthetic training data generation producing diverse question answer pairs that capture both user intent and the semantics of the underlying dataset We fine tune a compact model DeepSeek R1 Distill 8B using QLoRA with 4 bit quantization making the system suitable for deployment on commodity hardware We evaluate our approach on a dataset describing accessibility to essential services across Durangaldea Spain The fine tuned model achieves high accuracy across monolingual multilingual and unseen location scenarios demonstrating both robust generalization and reliable query generation Our results highlight that small domain specific models can achieve high precision for this task without relying on large proprietary LLMs making this methodology suitable for resource constrained environments and adaptable to broader multi dataset systems We evaluate our approach on a dataset describing accessibility to essential services across Durangaldea Spain The fine tuned model achieves high accuracy across monolingual multilingual and unseen location scenarios demonstrating both robust generalization and reliable query generation Our results highlight that small domain specific models can achieve high precision for this task without relying on large proprietary LLMs making this methodology suitable for resource constrained environments and adaptable to broader multi dataset systems.
title Querying Structured Data Through Natural Language Using Language Models
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2604.03057