An Audit on the Perspectives and Challenges of Hallucinations in NLP
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910603132534784 |
|---|---|
| author | Venkit, Pranav Narayanan Chakravorti, Tatiana Gupta, Vipul Biggs, Heidi Srinath, Mukund Goswami, Koustava Rajtmajer, Sarah Wilson, Shomir |
| author_facet | Venkit, Pranav Narayanan Chakravorti, Tatiana Gupta, Vipul Biggs, Heidi Srinath, Mukund Goswami, Koustava Rajtmajer, Sarah Wilson, Shomir |
| contents | We audit how hallucination in large language models (LLMs) is characterized in peer-reviewed literature, using a critical examination of 103 publications across NLP research. Through the examination of the literature, we identify a lack of agreement with the term `hallucination' in the field of NLP. Additionally, to compliment our audit, we conduct a survey with 171 practitioners from the field of NLP and AI to capture varying perspectives on hallucination. Our analysis calls for the necessity of explicit definitions and frameworks outlining hallucination within NLP, highlighting potential challenges, and our survey inputs provide a thematic understanding of the influence and ramifications of hallucination in society. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_07461 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | An Audit on the Perspectives and Challenges of Hallucinations in NLP Venkit, Pranav Narayanan Chakravorti, Tatiana Gupta, Vipul Biggs, Heidi Srinath, Mukund Goswami, Koustava Rajtmajer, Sarah Wilson, Shomir Computation and Language Artificial Intelligence We audit how hallucination in large language models (LLMs) is characterized in peer-reviewed literature, using a critical examination of 103 publications across NLP research. Through the examination of the literature, we identify a lack of agreement with the term `hallucination' in the field of NLP. Additionally, to compliment our audit, we conduct a survey with 171 practitioners from the field of NLP and AI to capture varying perspectives on hallucination. Our analysis calls for the necessity of explicit definitions and frameworks outlining hallucination within NLP, highlighting potential challenges, and our survey inputs provide a thematic understanding of the influence and ramifications of hallucination in society. |
| title | An Audit on the Perspectives and Challenges of Hallucinations in NLP |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2404.07461 |