From Text to CQL: Bridging Natural Language and Corpus Search Engine

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Lu, Luming, An, Jiyuan, Wang, Yujie, yang, Liner, Kong, Cunliang, Liu, Zhenghao, Wang, Shuo, Lin, Haozhe, Fang, Mingwei, Huang, Yaping, Yang, Erhong
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910339002531840
author Lu, Luming
An, Jiyuan
Wang, Yujie
yang, Liner
Kong, Cunliang
Liu, Zhenghao
Wang, Shuo
Lin, Haozhe
Fang, Mingwei
Huang, Yaping
Yang, Erhong
author_facet Lu, Luming
An, Jiyuan
Wang, Yujie
yang, Liner
Kong, Cunliang
Liu, Zhenghao
Wang, Shuo
Lin, Haozhe
Fang, Mingwei
Huang, Yaping
Yang, Erhong
contents Natural Language Processing (NLP) technologies have revolutionized the way we interact with information systems, with a significant focus on converting natural language queries into formal query languages such as SQL. However, less emphasis has been placed on the Corpus Query Language (CQL), a critical tool for linguistic research and detailed analysis within text corpora. The manual construction of CQL queries is a complex and time-intensive task that requires a great deal of expertise, which presents a notable challenge for both researchers and practitioners. This paper presents the first text-to-CQL task that aims to automate the translation of natural language into CQL. We present a comprehensive framework for this task, including a specifically curated large-scale dataset and methodologies leveraging large language models (LLMs) for effective text-to-CQL task. In addition, we established advanced evaluation metrics to assess the syntactic and semantic accuracy of the generated queries. We created innovative LLM-based conversion approaches and detailed experiments. The results demonstrate the efficacy of our methods and provide insights into the complexities of text-to-CQL task.
format Preprint
id arxiv_https___arxiv_org_abs_2402_13740
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle From Text to CQL: Bridging Natural Language and Corpus Search Engine
Lu, Luming
An, Jiyuan
Wang, Yujie
yang, Liner
Kong, Cunliang
Liu, Zhenghao
Wang, Shuo
Lin, Haozhe
Fang, Mingwei
Huang, Yaping
Yang, Erhong
Computation and Language
Natural Language Processing (NLP) technologies have revolutionized the way we interact with information systems, with a significant focus on converting natural language queries into formal query languages such as SQL. However, less emphasis has been placed on the Corpus Query Language (CQL), a critical tool for linguistic research and detailed analysis within text corpora. The manual construction of CQL queries is a complex and time-intensive task that requires a great deal of expertise, which presents a notable challenge for both researchers and practitioners. This paper presents the first text-to-CQL task that aims to automate the translation of natural language into CQL. We present a comprehensive framework for this task, including a specifically curated large-scale dataset and methodologies leveraging large language models (LLMs) for effective text-to-CQL task. In addition, we established advanced evaluation metrics to assess the syntactic and semantic accuracy of the generated queries. We created innovative LLM-based conversion approaches and detailed experiments. The results demonstrate the efficacy of our methods and provide insights into the complexities of text-to-CQL task.
title From Text to CQL: Bridging Natural Language and Corpus Search Engine
topic Computation and Language
url https://arxiv.org/abs/2402.13740