A Multilingual Dataset and Empirical Validation for the Mutual Reinforcement Effect in Information Extraction

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Gan, Chengguang, Lee, Sunbowen, Yin, Qingyu, Liang, Yunhao, He, Xinyang, Wei, Hanjun, Lim, Younghun, Wang, Shijian, Huang, Hexiang, Zhang, Qinghao, Ni, Shiwen, Mori, Tatsunori
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910121343320064
author Gan, Chengguang
Lee, Sunbowen
Yin, Qingyu
Liang, Yunhao
He, Xinyang
Wei, Hanjun
Lim, Younghun
Wang, Shijian
Huang, Hexiang
Zhang, Qinghao
Ni, Shiwen
Mori, Tatsunori
author_facet Gan, Chengguang
Lee, Sunbowen
Yin, Qingyu
Liang, Yunhao
He, Xinyang
Wei, Hanjun
Lim, Younghun
Wang, Shijian
Huang, Hexiang
Zhang, Qinghao
Ni, Shiwen
Mori, Tatsunori
contents The Mutual Reinforcement Effect (MRE) describes a phenomenon in information extraction where word-level and sentence-level tasks can mutually improve each other when jointly modeled. While prior work has reported MRE in Japanese, its generality across languages and task settings has not been empirically validated, largely due to the lack of multilingual MRE datasets. To address this limitation, we introduce the Multilingual MRE Mix dataset (MMM), which consists of 21 sub-datasets covering English, Japanese, and Chinese. We propose an LLM-assisted dataset translation and alignment framework that significantly reduces manual annotation effort while preserving the structural requirements of MRE tasks. Building on MMM, we adopt a unified input-output framework to train an open-domain information extraction model and conduct extensive empirical studies, including full fine-tuning ablations and the construction of knowledgeable verbalizers based on MRE-mix data. Experimental results show that 76 percent of the MMM sub-datasets consistently exhibit the Mutual Reinforcement Effect across languages. These findings provide systematic empirical validation of MRE in multilingual settings and demonstrate its practical value for information extraction.
format Preprint
id arxiv_https___arxiv_org_abs_2407_10953
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Multilingual Dataset and Empirical Validation for the Mutual Reinforcement Effect in Information Extraction
Gan, Chengguang
Lee, Sunbowen
Yin, Qingyu
Liang, Yunhao
He, Xinyang
Wei, Hanjun
Lim, Younghun
Wang, Shijian
Huang, Hexiang
Zhang, Qinghao
Ni, Shiwen
Mori, Tatsunori
Computation and Language
The Mutual Reinforcement Effect (MRE) describes a phenomenon in information extraction where word-level and sentence-level tasks can mutually improve each other when jointly modeled. While prior work has reported MRE in Japanese, its generality across languages and task settings has not been empirically validated, largely due to the lack of multilingual MRE datasets. To address this limitation, we introduce the Multilingual MRE Mix dataset (MMM), which consists of 21 sub-datasets covering English, Japanese, and Chinese. We propose an LLM-assisted dataset translation and alignment framework that significantly reduces manual annotation effort while preserving the structural requirements of MRE tasks. Building on MMM, we adopt a unified input-output framework to train an open-domain information extraction model and conduct extensive empirical studies, including full fine-tuning ablations and the construction of knowledgeable verbalizers based on MRE-mix data. Experimental results show that 76 percent of the MMM sub-datasets consistently exhibit the Mutual Reinforcement Effect across languages. These findings provide systematic empirical validation of MRE in multilingual settings and demonstrate its practical value for information extraction.
title A Multilingual Dataset and Empirical Validation for the Mutual Reinforcement Effect in Information Extraction
topic Computation and Language
url https://arxiv.org/abs/2407.10953