Large Language Models as Zero-Shot Keyphrase Extractors: A Preliminary Empirical Study
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914636428738560 |
|---|---|
| author | Song, Mingyang Geng, Xuelian Yao, Songfang Lu, Shilong Feng, Yi Jing, Liping |
| author_facet | Song, Mingyang Geng, Xuelian Yao, Songfang Lu, Shilong Feng, Yi Jing, Liping |
| contents | Zero-shot keyphrase extraction aims to build a keyphrase extractor without training by human-annotated data, which is challenging due to the limited human intervention involved. Challenging but worthwhile, zero-shot setting efficiently reduces the time and effort that data labeling takes. Recent efforts on pre-trained large language models (e.g., ChatGPT and ChatGLM) show promising performance on zero-shot settings, thus inspiring us to explore prompt-based methods. In this paper, we ask whether strong keyphrase extraction models can be constructed by directly prompting the large language model ChatGPT. Through experimental results, it is found that ChatGPT still has a lot of room for improvement in the keyphrase extraction task compared to existing state-of-the-art unsupervised and supervised models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_15156 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Large Language Models as Zero-Shot Keyphrase Extractors: A Preliminary Empirical Study Song, Mingyang Geng, Xuelian Yao, Songfang Lu, Shilong Feng, Yi Jing, Liping Computation and Language Zero-shot keyphrase extraction aims to build a keyphrase extractor without training by human-annotated data, which is challenging due to the limited human intervention involved. Challenging but worthwhile, zero-shot setting efficiently reduces the time and effort that data labeling takes. Recent efforts on pre-trained large language models (e.g., ChatGPT and ChatGLM) show promising performance on zero-shot settings, thus inspiring us to explore prompt-based methods. In this paper, we ask whether strong keyphrase extraction models can be constructed by directly prompting the large language model ChatGPT. Through experimental results, it is found that ChatGPT still has a lot of room for improvement in the keyphrase extraction task compared to existing state-of-the-art unsupervised and supervised models. |
| title | Large Language Models as Zero-Shot Keyphrase Extractors: A Preliminary Empirical Study |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2312.15156 |