Context-Aware Adapter Tuning for Few-Shot Relation Learning in Knowledge Graphs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Ran, Liu, Zhongzhou, Li, Xiaoli, Fang, Yuan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916442462486528
author Liu, Ran
Liu, Zhongzhou
Li, Xiaoli
Fang, Yuan
author_facet Liu, Ran
Liu, Zhongzhou
Li, Xiaoli
Fang, Yuan
contents Knowledge graphs (KGs) are instrumental in various real-world applications, yet they often suffer from incompleteness due to missing relations. To predict instances for novel relations with limited training examples, few-shot relation learning approaches have emerged, utilizing techniques such as meta-learning. However, the assumption is that novel relations in meta-testing and base relations in meta-training are independently and identically distributed, which may not hold in practice. To address the limitation, we propose RelAdapter, a context-aware adapter for few-shot relation learning in KGs designed to enhance the adaptation process in meta-learning. First, RelAdapter is equipped with a lightweight adapter module that facilitates relation-specific, tunable adaptation of meta-knowledge in a parameter-efficient manner. Second, RelAdapter is enriched with contextual information about the target relation, enabling enhanced adaptation to each distinct relation. Extensive experiments on three benchmark KGs validate the superiority of RelAdapter over state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2410_09123
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Context-Aware Adapter Tuning for Few-Shot Relation Learning in Knowledge Graphs
Liu, Ran
Liu, Zhongzhou
Li, Xiaoli
Fang, Yuan
Machine Learning
Artificial Intelligence
Knowledge graphs (KGs) are instrumental in various real-world applications, yet they often suffer from incompleteness due to missing relations. To predict instances for novel relations with limited training examples, few-shot relation learning approaches have emerged, utilizing techniques such as meta-learning. However, the assumption is that novel relations in meta-testing and base relations in meta-training are independently and identically distributed, which may not hold in practice. To address the limitation, we propose RelAdapter, a context-aware adapter for few-shot relation learning in KGs designed to enhance the adaptation process in meta-learning. First, RelAdapter is equipped with a lightweight adapter module that facilitates relation-specific, tunable adaptation of meta-knowledge in a parameter-efficient manner. Second, RelAdapter is enriched with contextual information about the target relation, enabling enhanced adaptation to each distinct relation. Extensive experiments on three benchmark KGs validate the superiority of RelAdapter over state-of-the-art methods.
title Context-Aware Adapter Tuning for Few-Shot Relation Learning in Knowledge Graphs
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2410.09123