Factuality of Large Language Models: A Survey

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Yuxia, Wang, Minghan, Manzoor, Muhammad Arslan, Liu, Fei, Georgiev, Georgi, Das, Rocktim Jyoti, Nakov, Preslav
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929568945799168
author Wang, Yuxia
Wang, Minghan
Manzoor, Muhammad Arslan
Liu, Fei
Georgiev, Georgi
Das, Rocktim Jyoti
Nakov, Preslav
author_facet Wang, Yuxia
Wang, Minghan
Manzoor, Muhammad Arslan
Liu, Fei
Georgiev, Georgi
Das, Rocktim Jyoti
Nakov, Preslav
contents Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a straightforward answer to a variety of questions in a single place. Unfortunately, in many cases, LLM responses are factually incorrect, which limits their applicability in real-world scenarios. As a result, research on evaluating and improving the factuality of LLMs has attracted a lot of attention recently. In this survey, we critically analyze existing work with the aim to identify the major challenges and their associated causes, pointing out to potential solutions for improving the factuality of LLMs, and analyzing the obstacles to automated factuality evaluation for open-ended text generation. We further offer an outlook on where future research should go.
format Preprint
id arxiv_https___arxiv_org_abs_2402_02420
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Factuality of Large Language Models: A Survey
Wang, Yuxia
Wang, Minghan
Manzoor, Muhammad Arslan
Liu, Fei
Georgiev, Georgi
Das, Rocktim Jyoti
Nakov, Preslav
Computation and Language
Artificial Intelligence
Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a straightforward answer to a variety of questions in a single place. Unfortunately, in many cases, LLM responses are factually incorrect, which limits their applicability in real-world scenarios. As a result, research on evaluating and improving the factuality of LLMs has attracted a lot of attention recently. In this survey, we critically analyze existing work with the aim to identify the major challenges and their associated causes, pointing out to potential solutions for improving the factuality of LLMs, and analyzing the obstacles to automated factuality evaluation for open-ended text generation. We further offer an outlook on where future research should go.
title Factuality of Large Language Models: A Survey
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2402.02420