Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Siyi, Li, Yang, Li, Jiang, Yang, Shan, Lan, Yunshi
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912164894212096
author Liu, Siyi
Li, Yang
Li, Jiang
Yang, Shan
Lan, Yunshi
author_facet Liu, Siyi
Li, Yang
Li, Jiang
Yang, Shan
Lan, Yunshi
contents Recent research in zero-shot Relation Extraction (RE) has focused on using Large Language Models (LLMs) due to their impressive zero-shot capabilities. However, current methods often perform suboptimally, mainly due to a lack of detailed, context-specific prompts needed for understanding various sentences and relations. To address this, we introduce the Self-Prompting framework, a novel method designed to fully harness the embedded RE knowledge within LLMs. Specifically, our framework employs a three-stage diversity approach to prompt LLMs, generating multiple synthetic samples that encapsulate specific relations from scratch. These generated samples act as in-context learning samples, offering explicit and context-specific guidance to efficiently prompt LLMs for RE. Experimental evaluations on benchmark datasets show our approach outperforms existing LLM-based zero-shot RE methods. Additionally, our experiments confirm the effectiveness of our generation pipeline in producing high-quality synthetic data that enhances performance.
format Preprint
id arxiv_https___arxiv_org_abs_2410_01154
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting
Liu, Siyi
Li, Yang
Li, Jiang
Yang, Shan
Lan, Yunshi
Information Retrieval
Computation and Language
Recent research in zero-shot Relation Extraction (RE) has focused on using Large Language Models (LLMs) due to their impressive zero-shot capabilities. However, current methods often perform suboptimally, mainly due to a lack of detailed, context-specific prompts needed for understanding various sentences and relations. To address this, we introduce the Self-Prompting framework, a novel method designed to fully harness the embedded RE knowledge within LLMs. Specifically, our framework employs a three-stage diversity approach to prompt LLMs, generating multiple synthetic samples that encapsulate specific relations from scratch. These generated samples act as in-context learning samples, offering explicit and context-specific guidance to efficiently prompt LLMs for RE. Experimental evaluations on benchmark datasets show our approach outperforms existing LLM-based zero-shot RE methods. Additionally, our experiments confirm the effectiveness of our generation pipeline in producing high-quality synthetic data that enhances performance.
title Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting
topic Information Retrieval
Computation and Language
url https://arxiv.org/abs/2410.01154