Saved in:
Bibliographic Details
Main Authors: Zhou, Yang, Shan, Shimin, Wei, Hongkui, Zhao, Zhehuan, Feng, Wenshuo
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.20787
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910465567752192
author Zhou, Yang
Shan, Shimin
Wei, Hongkui
Zhao, Zhehuan
Feng, Wenshuo
author_facet Zhou, Yang
Shan, Shimin
Wei, Hongkui
Zhao, Zhehuan
Feng, Wenshuo
contents Relation Extraction (RE) aims at recognizing the relation between pairs of entities mentioned in a text. Advances in LLMs have had a tremendous impact on NLP. In this work, we propose a textual data augmentation framework called PGA for improving the performance of models for RE in the scientific domain. The framework introduces two ways of data augmentation, utilizing a LLM to obtain pseudo-samples with the same sentence meaning but with different representations and forms by paraphrasing the original training set samples. As well as instructing LLM to generate sentences that implicitly contain information about the corresponding labels based on the relation and entity of the original training set samples. These two kinds of pseudo-samples participate in the training of the RE model together with the original dataset, respectively. The PGA framework in the experiment improves the F1 scores of the three mainstream models for RE within the scientific domain. Also, using a LLM to obtain samples can effectively reduce the cost of manually labeling data.
format Preprint
id arxiv_https___arxiv_org_abs_2405_20787
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle PGA-SciRE: Harnessing LLM on Data Augmentation for Enhancing Scientific Relation Extraction
Zhou, Yang
Shan, Shimin
Wei, Hongkui
Zhao, Zhehuan
Feng, Wenshuo
Computation and Language
Relation Extraction (RE) aims at recognizing the relation between pairs of entities mentioned in a text. Advances in LLMs have had a tremendous impact on NLP. In this work, we propose a textual data augmentation framework called PGA for improving the performance of models for RE in the scientific domain. The framework introduces two ways of data augmentation, utilizing a LLM to obtain pseudo-samples with the same sentence meaning but with different representations and forms by paraphrasing the original training set samples. As well as instructing LLM to generate sentences that implicitly contain information about the corresponding labels based on the relation and entity of the original training set samples. These two kinds of pseudo-samples participate in the training of the RE model together with the original dataset, respectively. The PGA framework in the experiment improves the F1 scores of the three mainstream models for RE within the scientific domain. Also, using a LLM to obtain samples can effectively reduce the cost of manually labeling data.
title PGA-SciRE: Harnessing LLM on Data Augmentation for Enhancing Scientific Relation Extraction
topic Computation and Language
url https://arxiv.org/abs/2405.20787