Insert or Attach: Taxonomy Completion via Box Embedding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xue, Wei, Shen, Yongliang, Ren, Wenqi, Guo, Jietian, Pu, Shiliang, Lu, Weiming
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916289948155904
author Xue, Wei
Shen, Yongliang
Ren, Wenqi
Guo, Jietian
Pu, Shiliang
Lu, Weiming
author_facet Xue, Wei
Shen, Yongliang
Ren, Wenqi
Guo, Jietian
Pu, Shiliang
Lu, Weiming
contents Taxonomy completion, enriching existing taxonomies by inserting new concepts as parents or attaching them as children, has gained significant interest. Previous approaches embed concepts as vectors in Euclidean space, which makes it difficult to model asymmetric relations in taxonomy. In addition, they introduce pseudo-leaves to convert attachment cases into insertion cases, leading to an incorrect bias in network learning dominated by numerous pseudo-leaves. Addressing these, our framework, TaxBox, leverages box containment and center closeness to design two specialized geometric scorers within the box embedding space. These scorers are tailored for insertion and attachment operations and can effectively capture intrinsic relationships between concepts by optimizing on a granular box constraint loss. We employ a dynamic ranking loss mechanism to balance the scores from these scorers, allowing adaptive adjustments of insertion and attachment scores. Experiments on four real-world datasets show that TaxBox significantly outperforms previous methods, yielding substantial improvements over prior methods in real-world datasets, with average performance boosts of 6.7%, 34.9%, and 51.4% in MRR, Hit@1, and Prec@1, respectively.
format Preprint
id arxiv_https___arxiv_org_abs_2305_11004
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Insert or Attach: Taxonomy Completion via Box Embedding
Xue, Wei
Shen, Yongliang
Ren, Wenqi
Guo, Jietian
Pu, Shiliang
Lu, Weiming
Computation and Language
Taxonomy completion, enriching existing taxonomies by inserting new concepts as parents or attaching them as children, has gained significant interest. Previous approaches embed concepts as vectors in Euclidean space, which makes it difficult to model asymmetric relations in taxonomy. In addition, they introduce pseudo-leaves to convert attachment cases into insertion cases, leading to an incorrect bias in network learning dominated by numerous pseudo-leaves. Addressing these, our framework, TaxBox, leverages box containment and center closeness to design two specialized geometric scorers within the box embedding space. These scorers are tailored for insertion and attachment operations and can effectively capture intrinsic relationships between concepts by optimizing on a granular box constraint loss. We employ a dynamic ranking loss mechanism to balance the scores from these scorers, allowing adaptive adjustments of insertion and attachment scores. Experiments on four real-world datasets show that TaxBox significantly outperforms previous methods, yielding substantial improvements over prior methods in real-world datasets, with average performance boosts of 6.7%, 34.9%, and 51.4% in MRR, Hit@1, and Prec@1, respectively.
title Insert or Attach: Taxonomy Completion via Box Embedding
topic Computation and Language
url https://arxiv.org/abs/2305.11004