Konstruktor: A Strong Baseline for Simple Knowledge Graph Question Answering

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Lysyuk, Maria, Salnikov, Mikhail, Braslavski, Pavel, Panchenko, Alexander
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913514578247680
author Lysyuk, Maria
Salnikov, Mikhail
Braslavski, Pavel
Panchenko, Alexander
author_facet Lysyuk, Maria
Salnikov, Mikhail
Braslavski, Pavel
Panchenko, Alexander
contents While being one of the most popular question types, simple questions such as "Who is the author of Cinderella?", are still not completely solved. Surprisingly, even the most powerful modern Large Language Models are prone to errors when dealing with such questions, especially when dealing with rare entities. At the same time, as an answer may be one hop away from the question entity, one can try to develop a method that uses structured knowledge graphs (KGs) to answer such questions. In this paper, we introduce Konstruktor - an efficient and robust approach that breaks down the problem into three steps: (i) entity extraction and entity linking, (ii) relation prediction, and (iii) querying the knowledge graph. Our approach integrates language models and knowledge graphs, exploiting the power of the former and the interpretability of the latter. We experiment with two named entity recognition and entity linking methods and several relation detection techniques. We show that for relation detection, the most challenging step of the workflow, a combination of relation classification/generation and ranking outperforms other methods. We report Konstruktor's strong results on four datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2409_15902
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Konstruktor: A Strong Baseline for Simple Knowledge Graph Question Answering
Lysyuk, Maria
Salnikov, Mikhail
Braslavski, Pavel
Panchenko, Alexander
Computation and Language
While being one of the most popular question types, simple questions such as "Who is the author of Cinderella?", are still not completely solved. Surprisingly, even the most powerful modern Large Language Models are prone to errors when dealing with such questions, especially when dealing with rare entities. At the same time, as an answer may be one hop away from the question entity, one can try to develop a method that uses structured knowledge graphs (KGs) to answer such questions. In this paper, we introduce Konstruktor - an efficient and robust approach that breaks down the problem into three steps: (i) entity extraction and entity linking, (ii) relation prediction, and (iii) querying the knowledge graph. Our approach integrates language models and knowledge graphs, exploiting the power of the former and the interpretability of the latter. We experiment with two named entity recognition and entity linking methods and several relation detection techniques. We show that for relation detection, the most challenging step of the workflow, a combination of relation classification/generation and ranking outperforms other methods. We report Konstruktor's strong results on four datasets.
title Konstruktor: A Strong Baseline for Simple Knowledge Graph Question Answering
topic Computation and Language
url https://arxiv.org/abs/2409.15902