Automatic Context Pattern Generation for Entity Set Expansion

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Yinghui, Huang, Shulin, Zhang, Xinwei, Zhou, Qingyu, Li, Yangning, Liu, Ruiyang, Cao, Yunbo, Zheng, Hai-Tao, Shen, Ying
Format: Preprint
Veröffentlicht: 2022
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929559453040640
author Li, Yinghui
Huang, Shulin
Zhang, Xinwei
Zhou, Qingyu
Li, Yangning
Liu, Ruiyang
Cao, Yunbo
Zheng, Hai-Tao
Shen, Ying
author_facet Li, Yinghui
Huang, Shulin
Zhang, Xinwei
Zhou, Qingyu
Li, Yangning
Liu, Ruiyang
Cao, Yunbo
Zheng, Hai-Tao
Shen, Ying
contents Entity Set Expansion (ESE) is a valuable task that aims to find entities of the target semantic class described by given seed entities. Various Natural Language Processing (NLP) and Information Retrieval (IR) downstream applications have benefited from ESE due to its ability to discover knowledge. Although existing corpus-based ESE methods have achieved great progress, they still rely on corpora with high-quality entity information annotated, because most of them need to obtain the context patterns through the position of the entity in a sentence. Therefore, the quality of the given corpora and their entity annotation has become the bottleneck that limits the performance of such methods. To overcome this dilemma and make the ESE models free from the dependence on entity annotation, our work aims to explore a new ESE paradigm, namely corpus-independent ESE. Specifically, we devise a context pattern generation module that utilizes autoregressive language models (e.g., GPT-2) to automatically generate high-quality context patterns for entities. In addition, we propose the GAPA, a novel ESE framework that leverages the aforementioned GenerAted PAtterns to expand target entities. Extensive experiments and detailed analyses on three widely used datasets demonstrate the effectiveness of our method. All the codes of our experiments are available at https://github.com/geekjuruo/GAPA.
format Preprint
id arxiv_https___arxiv_org_abs_2207_08087
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Automatic Context Pattern Generation for Entity Set Expansion
Li, Yinghui
Huang, Shulin
Zhang, Xinwei
Zhou, Qingyu
Li, Yangning
Liu, Ruiyang
Cao, Yunbo
Zheng, Hai-Tao
Shen, Ying
Computation and Language
Information Retrieval
Entity Set Expansion (ESE) is a valuable task that aims to find entities of the target semantic class described by given seed entities. Various Natural Language Processing (NLP) and Information Retrieval (IR) downstream applications have benefited from ESE due to its ability to discover knowledge. Although existing corpus-based ESE methods have achieved great progress, they still rely on corpora with high-quality entity information annotated, because most of them need to obtain the context patterns through the position of the entity in a sentence. Therefore, the quality of the given corpora and their entity annotation has become the bottleneck that limits the performance of such methods. To overcome this dilemma and make the ESE models free from the dependence on entity annotation, our work aims to explore a new ESE paradigm, namely corpus-independent ESE. Specifically, we devise a context pattern generation module that utilizes autoregressive language models (e.g., GPT-2) to automatically generate high-quality context patterns for entities. In addition, we propose the GAPA, a novel ESE framework that leverages the aforementioned GenerAted PAtterns to expand target entities. Extensive experiments and detailed analyses on three widely used datasets demonstrate the effectiveness of our method. All the codes of our experiments are available at https://github.com/geekjuruo/GAPA.
title Automatic Context Pattern Generation for Entity Set Expansion
topic Computation and Language
Information Retrieval
url https://arxiv.org/abs/2207.08087