The Role of Global and Local Context in Named Entity Recognition
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917699870785536 |
|---|---|
| author | Amalvy, Arthur Labatut, Vincent Dufour, Richard |
| author_facet | Amalvy, Arthur Labatut, Vincent Dufour, Richard |
| contents | Pre-trained transformer-based models have recently shown great performance when applied to Named Entity Recognition (NER). As the complexity of their self-attention mechanism prevents them from processing long documents at once, these models are usually applied in a sequential fashion. Such an approach unfortunately only incorporates local context and prevents leveraging global document context in long documents such as novels, which might hinder performance. In this article, we explore the impact of global document context, and its relationships with local context. We find that correctly retrieving global document context has a greater impact on performance than only leveraging local context, prompting for further research on how to better retrieve that context. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_03132 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | The Role of Global and Local Context in Named Entity Recognition Amalvy, Arthur Labatut, Vincent Dufour, Richard Computation and Language Pre-trained transformer-based models have recently shown great performance when applied to Named Entity Recognition (NER). As the complexity of their self-attention mechanism prevents them from processing long documents at once, these models are usually applied in a sequential fashion. Such an approach unfortunately only incorporates local context and prevents leveraging global document context in long documents such as novels, which might hinder performance. In this article, we explore the impact of global document context, and its relationships with local context. We find that correctly retrieving global document context has a greater impact on performance than only leveraging local context, prompting for further research on how to better retrieve that context. |
| title | The Role of Global and Local Context in Named Entity Recognition |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2305.03132 |