Text2Cypher: Data Pruning using Hard Example Selection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Author: Ozsoy, Makbule Gulcin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918135476518912
author Ozsoy, Makbule Gulcin
author_facet Ozsoy, Makbule Gulcin
contents Database query languages such as SQL for relational databases and Cypher for graph databases have been widely adopted. Recent advancements in large language models (LLMs) enable natural language interactions with databases through models like Text2SQL and Text2Cypher. Fine-tuning these models typically requires large, diverse datasets containing non-trivial examples. However, as dataset size increases, the cost of fine-tuning also rises. This makes smaller, high-quality datasets essential for reducing costs for the same or better performance. In this paper, we propose five hard-example selection techniques for pruning the Text2Cypher dataset, aiming to preserve or improve performance while reducing resource usage. Our results show that these hard-example selection approaches can halve training time and costs with minimal impact on performance, and demonstrates that hard-example selection provides a cost-effective solution.
format Preprint
id arxiv_https___arxiv_org_abs_2505_05122
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Text2Cypher: Data Pruning using Hard Example Selection
Ozsoy, Makbule Gulcin
Databases
Machine Learning
Database query languages such as SQL for relational databases and Cypher for graph databases have been widely adopted. Recent advancements in large language models (LLMs) enable natural language interactions with databases through models like Text2SQL and Text2Cypher. Fine-tuning these models typically requires large, diverse datasets containing non-trivial examples. However, as dataset size increases, the cost of fine-tuning also rises. This makes smaller, high-quality datasets essential for reducing costs for the same or better performance. In this paper, we propose five hard-example selection techniques for pruning the Text2Cypher dataset, aiming to preserve or improve performance while reducing resource usage. Our results show that these hard-example selection approaches can halve training time and costs with minimal impact on performance, and demonstrates that hard-example selection provides a cost-effective solution.
title Text2Cypher: Data Pruning using Hard Example Selection
topic Databases
Machine Learning
url https://arxiv.org/abs/2505.05122