Show Less, Instruct More: Enriching Prompts with Definitions and Guidelines for Zero-Shot NER
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913505086537728 |
|---|---|
| author | Zamai, Andrew Zugarini, Andrea Rigutini, Leonardo Ernandes, Marco Maggini, Marco |
| author_facet | Zamai, Andrew Zugarini, Andrea Rigutini, Leonardo Ernandes, Marco Maggini, Marco |
| contents | Recently, several specialized instruction-tuned Large Language Models (LLMs) for Named Entity Recognition (NER) have emerged. Compared to traditional NER approaches, these models have demonstrated strong generalization capabilities. Existing LLMs primarily focus on addressing zero-shot NER on Out-of-Domain inputs, while fine-tuning on an extensive number of entity classes that often highly or completely overlap with test sets. In this work instead, we propose SLIMER, an approach designed to tackle never-seen-before entity tags by instructing the model on fewer examples, and by leveraging a prompt enriched with definition and guidelines. Experiments demonstrate that definition and guidelines yield better performance, faster and more robust learning, particularly when labelling unseen named entities. Furthermore, SLIMER performs comparably to state-of-the-art approaches in out-of-domain zero-shot NER, while being trained in a more fair, though certainly more challenging, setting. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_01272 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Show Less, Instruct More: Enriching Prompts with Definitions and Guidelines for Zero-Shot NER Zamai, Andrew Zugarini, Andrea Rigutini, Leonardo Ernandes, Marco Maggini, Marco Computation and Language Recently, several specialized instruction-tuned Large Language Models (LLMs) for Named Entity Recognition (NER) have emerged. Compared to traditional NER approaches, these models have demonstrated strong generalization capabilities. Existing LLMs primarily focus on addressing zero-shot NER on Out-of-Domain inputs, while fine-tuning on an extensive number of entity classes that often highly or completely overlap with test sets. In this work instead, we propose SLIMER, an approach designed to tackle never-seen-before entity tags by instructing the model on fewer examples, and by leveraging a prompt enriched with definition and guidelines. Experiments demonstrate that definition and guidelines yield better performance, faster and more robust learning, particularly when labelling unseen named entities. Furthermore, SLIMER performs comparably to state-of-the-art approaches in out-of-domain zero-shot NER, while being trained in a more fair, though certainly more challenging, setting. |
| title | Show Less, Instruct More: Enriching Prompts with Definitions and Guidelines for Zero-Shot NER |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2407.01272 |