GenAudit: Fixing Factual Errors in Language Model Outputs with Evidence
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912192789479424 |
|---|---|
| author | Krishna, Kundan Ramprasad, Sanjana Gupta, Prakhar Wallace, Byron C. Lipton, Zachary C. Bigham, Jeffrey P. |
| author_facet | Krishna, Kundan Ramprasad, Sanjana Gupta, Prakhar Wallace, Byron C. Lipton, Zachary C. Bigham, Jeffrey P. |
| contents | LLMs can generate factually incorrect statements even when provided access to reference documents. Such errors can be dangerous in high-stakes applications (e.g., document-grounded QA for healthcare or finance). We present GenAudit -- a tool intended to assist fact-checking LLM responses for document-grounded tasks. GenAudit suggests edits to the LLM response by revising or removing claims that are not supported by the reference document, and also presents evidence from the reference for facts that do appear to have support. We train models to execute these tasks, and design an interactive interface to present suggested edits and evidence to users. Comprehensive evaluation by human raters shows that GenAudit can detect errors in 8 different LLM outputs when summarizing documents from diverse domains. User studies demonstrate that using GenAudit can substantially improve the performance of humans at finding errors in LLM-generated summaries. We release our tool (GenAudit) and fact-checking model for public use. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_12566 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | GenAudit: Fixing Factual Errors in Language Model Outputs with Evidence Krishna, Kundan Ramprasad, Sanjana Gupta, Prakhar Wallace, Byron C. Lipton, Zachary C. Bigham, Jeffrey P. Computation and Language Machine Learning LLMs can generate factually incorrect statements even when provided access to reference documents. Such errors can be dangerous in high-stakes applications (e.g., document-grounded QA for healthcare or finance). We present GenAudit -- a tool intended to assist fact-checking LLM responses for document-grounded tasks. GenAudit suggests edits to the LLM response by revising or removing claims that are not supported by the reference document, and also presents evidence from the reference for facts that do appear to have support. We train models to execute these tasks, and design an interactive interface to present suggested edits and evidence to users. Comprehensive evaluation by human raters shows that GenAudit can detect errors in 8 different LLM outputs when summarizing documents from diverse domains. User studies demonstrate that using GenAudit can substantially improve the performance of humans at finding errors in LLM-generated summaries. We release our tool (GenAudit) and fact-checking model for public use. |
| title | GenAudit: Fixing Factual Errors in Language Model Outputs with Evidence |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2402.12566 |