YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extraction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xiao, Xinglin, Wang, Yijie, Xu, Nan, Wang, Yuqi, Yang, Hanxuan, Wang, Minzheng, Luo, Yin, Wang, Lei, Mao, Wenji, Zeng, Daniel
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916188321218560
author Xiao, Xinglin
Wang, Yijie
Xu, Nan
Wang, Yuqi
Yang, Hanxuan
Wang, Minzheng
Luo, Yin
Wang, Lei
Mao, Wenji
Zeng, Daniel
author_facet Xiao, Xinglin
Wang, Yijie
Xu, Nan
Wang, Yuqi
Yang, Hanxuan
Wang, Minzheng
Luo, Yin
Wang, Lei
Mao, Wenji
Zeng, Daniel
contents The difficulty of the information extraction task lies in dealing with the task-specific label schemas and heterogeneous data structures. Recent work has proposed methods based on large language models to uniformly model different information extraction tasks. However, these existing methods are deficient in their information extraction capabilities for Chinese languages other than English. In this paper, we propose an end-to-end chat-enhanced instruction tuning framework for universal information extraction (YAYI-UIE), which supports both Chinese and English. Specifically, we utilize dialogue data and information extraction data to enhance the information extraction performance jointly. Experimental results show that our proposed framework achieves state-of-the-art performance on Chinese datasets while also achieving comparable performance on English datasets under both supervised settings and zero-shot settings.
format Preprint
id arxiv_https___arxiv_org_abs_2312_15548
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extraction
Xiao, Xinglin
Wang, Yijie
Xu, Nan
Wang, Yuqi
Yang, Hanxuan
Wang, Minzheng
Luo, Yin
Wang, Lei
Mao, Wenji
Zeng, Daniel
Computation and Language
Artificial Intelligence
The difficulty of the information extraction task lies in dealing with the task-specific label schemas and heterogeneous data structures. Recent work has proposed methods based on large language models to uniformly model different information extraction tasks. However, these existing methods are deficient in their information extraction capabilities for Chinese languages other than English. In this paper, we propose an end-to-end chat-enhanced instruction tuning framework for universal information extraction (YAYI-UIE), which supports both Chinese and English. Specifically, we utilize dialogue data and information extraction data to enhance the information extraction performance jointly. Experimental results show that our proposed framework achieves state-of-the-art performance on Chinese datasets while also achieving comparable performance on English datasets under both supervised settings and zero-shot settings.
title YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extraction
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2312.15548