Multi-Hop Reasoning for Question Answering with Hyperbolic Representations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Welz, Simon, Flek, Lucie, Karimi, Akbar
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909675836932096
author Welz, Simon
Flek, Lucie
Karimi, Akbar
author_facet Welz, Simon
Flek, Lucie
Karimi, Akbar
contents Hyperbolic representations are effective in modeling knowledge graph data which is prevalently used to facilitate multi-hop reasoning. However, a rigorous and detailed comparison of the two spaces for this task is lacking. In this paper, through a simple integration of hyperbolic representations with an encoder-decoder model, we perform a controlled and comprehensive set of experiments to compare the capacity of hyperbolic space versus Euclidean space in multi-hop reasoning. Our results show that the former consistently outperforms the latter across a diverse set of datasets. In addition, through an ablation study, we show that a learnable curvature initialized with the delta hyperbolicity of the utilized data yields superior results to random initializations. Furthermore, our findings suggest that hyperbolic representations can be significantly more advantageous when the datasets exhibit a more hierarchical structure.
format Preprint
id arxiv_https___arxiv_org_abs_2507_03612
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multi-Hop Reasoning for Question Answering with Hyperbolic Representations
Welz, Simon
Flek, Lucie
Karimi, Akbar
Computation and Language
Artificial Intelligence
Hyperbolic representations are effective in modeling knowledge graph data which is prevalently used to facilitate multi-hop reasoning. However, a rigorous and detailed comparison of the two spaces for this task is lacking. In this paper, through a simple integration of hyperbolic representations with an encoder-decoder model, we perform a controlled and comprehensive set of experiments to compare the capacity of hyperbolic space versus Euclidean space in multi-hop reasoning. Our results show that the former consistently outperforms the latter across a diverse set of datasets. In addition, through an ablation study, we show that a learnable curvature initialized with the delta hyperbolicity of the utilized data yields superior results to random initializations. Furthermore, our findings suggest that hyperbolic representations can be significantly more advantageous when the datasets exhibit a more hierarchical structure.
title Multi-Hop Reasoning for Question Answering with Hyperbolic Representations
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2507.03612