How to Evaluate Coreference in Literary Texts?
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914625892646912 |
|---|---|
| author | Duron-Tejedor, Ana-Isabel Amsili, Pascal Poibeau, Thierry |
| author_facet | Duron-Tejedor, Ana-Isabel Amsili, Pascal Poibeau, Thierry |
| contents | In this short paper, we examine the main metrics used to evaluate textual coreference and we detail some of their limitations. We show that a unique score cannot represent the full complexity of the problem at stake, and is thus uninformative, or even misleading. We propose a new way of evaluating coreference, taking into account the context (in our case, the analysis of fictions, esp. novels). More specifically, we propose to distinguish long coreference chains (corresponding to main characters), from short ones (corresponding to secondary characters), and singletons (isolated elements). This way, we hope to get more interpretable and thus more informative results through evaluation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_00238 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | How to Evaluate Coreference in Literary Texts? Duron-Tejedor, Ana-Isabel Amsili, Pascal Poibeau, Thierry Computation and Language Artificial Intelligence In this short paper, we examine the main metrics used to evaluate textual coreference and we detail some of their limitations. We show that a unique score cannot represent the full complexity of the problem at stake, and is thus uninformative, or even misleading. We propose a new way of evaluating coreference, taking into account the context (in our case, the analysis of fictions, esp. novels). More specifically, we propose to distinguish long coreference chains (corresponding to main characters), from short ones (corresponding to secondary characters), and singletons (isolated elements). This way, we hope to get more interpretable and thus more informative results through evaluation. |
| title | How to Evaluate Coreference in Literary Texts? |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2401.00238 |