SPARQL Generation with Entity Pre-trained GPT for KG Question Answering
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929231564374016 |
|---|---|
| author | Bustamante, Diego Takeda, Hideaki |
| author_facet | Bustamante, Diego Takeda, Hideaki |
| contents | Knowledge Graphs popularity has been rapidly growing in last years. All that knowledge is available for people to query it through the many online databases on the internet. Though, it would be a great achievement if non-programmer users could access whatever information they want to know. There has been a lot of effort oriented to solve this task using natural language processing tools and creativity encouragement by way of many challenges. Our approach focuses on assuming a correct entity linking on the natural language questions and training a GPT model to create SPARQL queries from them. We managed to isolate which property of the task can be the most difficult to solve at few or zero-shot and we proposed pre-training on all entities (under CWA) to improve the performance. We obtained a 62.703% accuracy of exact SPARQL matches on testing at 3-shots, a F1 of 0.809 on the entity linking challenge and a F1 of 0.009 on the question answering challenge. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_00969 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SPARQL Generation with Entity Pre-trained GPT for KG Question Answering Bustamante, Diego Takeda, Hideaki Computation and Language Artificial Intelligence Databases Information Retrieval 68P20, 68T50 H.2.3; H.3.3; I.2.7 Knowledge Graphs popularity has been rapidly growing in last years. All that knowledge is available for people to query it through the many online databases on the internet. Though, it would be a great achievement if non-programmer users could access whatever information they want to know. There has been a lot of effort oriented to solve this task using natural language processing tools and creativity encouragement by way of many challenges. Our approach focuses on assuming a correct entity linking on the natural language questions and training a GPT model to create SPARQL queries from them. We managed to isolate which property of the task can be the most difficult to solve at few or zero-shot and we proposed pre-training on all entities (under CWA) to improve the performance. We obtained a 62.703% accuracy of exact SPARQL matches on testing at 3-shots, a F1 of 0.809 on the entity linking challenge and a F1 of 0.009 on the question answering challenge. |
| title | SPARQL Generation with Entity Pre-trained GPT for KG Question Answering |
| topic | Computation and Language Artificial Intelligence Databases Information Retrieval 68P20, 68T50 H.2.3; H.3.3; I.2.7 |
| url | https://arxiv.org/abs/2402.00969 |