Major Entity Identification: A Generalizable Alternative to Coreference Resolution

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Manikantan, Kawshik, Toshniwal, Shubham, Tapaswi, Makarand, Gandhi, Vineet
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929527496638464
author Manikantan, Kawshik
Toshniwal, Shubham
Tapaswi, Makarand
Gandhi, Vineet
author_facet Manikantan, Kawshik
Toshniwal, Shubham
Tapaswi, Makarand
Gandhi, Vineet
contents The limited generalization of coreference resolution (CR) models has been a major bottleneck in the task's broad application. Prior work has identified annotation differences, especially for mention detection, as one of the main reasons for the generalization gap and proposed using additional annotated target domain data. Rather than relying on this additional annotation, we propose an alternative referential task, Major Entity Identification (MEI), where we: (a) assume the target entities to be specified in the input, and (b) limit the task to only the frequent entities. Through extensive experiments, we demonstrate that MEI models generalize well across domains on multiple datasets with supervised models and LLM-based few-shot prompting. Additionally, MEI fits the classification framework, which enables the use of robust and intuitive classification-based metrics. Finally, MEI is also of practical use as it allows a user to search for all mentions of a particular entity or a group of entities of interest.
format Preprint
id arxiv_https___arxiv_org_abs_2406_14654
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Major Entity Identification: A Generalizable Alternative to Coreference Resolution
Manikantan, Kawshik
Toshniwal, Shubham
Tapaswi, Makarand
Gandhi, Vineet
Computation and Language
Artificial Intelligence
Machine Learning
I.2.7
The limited generalization of coreference resolution (CR) models has been a major bottleneck in the task's broad application. Prior work has identified annotation differences, especially for mention detection, as one of the main reasons for the generalization gap and proposed using additional annotated target domain data. Rather than relying on this additional annotation, we propose an alternative referential task, Major Entity Identification (MEI), where we: (a) assume the target entities to be specified in the input, and (b) limit the task to only the frequent entities. Through extensive experiments, we demonstrate that MEI models generalize well across domains on multiple datasets with supervised models and LLM-based few-shot prompting. Additionally, MEI fits the classification framework, which enables the use of robust and intuitive classification-based metrics. Finally, MEI is also of practical use as it allows a user to search for all mentions of a particular entity or a group of entities of interest.
title Major Entity Identification: A Generalizable Alternative to Coreference Resolution
topic Computation and Language
Artificial Intelligence
Machine Learning
I.2.7
url https://arxiv.org/abs/2406.14654