RefChecker: Reference-based Fine-grained Hallucination Checker and Benchmark for Large Language Models
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910457807241216 |
|---|---|
| author | Hu, Xiangkun Ru, Dongyu Qiu, Lin Guo, Qipeng Zhang, Tianhang Xu, Yang Luo, Yun Liu, Pengfei Zhang, Yue Zhang, Zheng |
| author_facet | Hu, Xiangkun Ru, Dongyu Qiu, Lin Guo, Qipeng Zhang, Tianhang Xu, Yang Luo, Yun Liu, Pengfei Zhang, Yue Zhang, Zheng |
| contents | Large Language Models (LLMs) have shown impressive capabilities but also a concerning tendency to hallucinate. This paper presents RefChecker, a framework that introduces claim-triplets to represent claims in LLM responses, aiming to detect fine-grained hallucinations. In RefChecker, an extractor generates claim-triplets from a response, which are then evaluated by a checker against a reference. We delineate three task settings: Zero, Noisy and Accurate Context, to reflect various real-world use cases. We curated a benchmark spanning various NLP tasks and annotated 11k claim-triplets from 2.1k responses by seven LLMs. RefChecker supports both proprietary and open-source models as the extractor and checker. Experiments demonstrate that claim-triplets enable superior hallucination detection, compared to other granularities such as response, sentence and sub-sentence level claims. RefChecker outperforms prior methods by 6.8 to 26.1 points on our benchmark and the checking results of RefChecker are strongly aligned with human judgments. This work is open sourced at https://github.com/amazon-science/RefChecker |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_14486 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | RefChecker: Reference-based Fine-grained Hallucination Checker and Benchmark for Large Language Models Hu, Xiangkun Ru, Dongyu Qiu, Lin Guo, Qipeng Zhang, Tianhang Xu, Yang Luo, Yun Liu, Pengfei Zhang, Yue Zhang, Zheng Computation and Language Large Language Models (LLMs) have shown impressive capabilities but also a concerning tendency to hallucinate. This paper presents RefChecker, a framework that introduces claim-triplets to represent claims in LLM responses, aiming to detect fine-grained hallucinations. In RefChecker, an extractor generates claim-triplets from a response, which are then evaluated by a checker against a reference. We delineate three task settings: Zero, Noisy and Accurate Context, to reflect various real-world use cases. We curated a benchmark spanning various NLP tasks and annotated 11k claim-triplets from 2.1k responses by seven LLMs. RefChecker supports both proprietary and open-source models as the extractor and checker. Experiments demonstrate that claim-triplets enable superior hallucination detection, compared to other granularities such as response, sentence and sub-sentence level claims. RefChecker outperforms prior methods by 6.8 to 26.1 points on our benchmark and the checking results of RefChecker are strongly aligned with human judgments. This work is open sourced at https://github.com/amazon-science/RefChecker |
| title | RefChecker: Reference-based Fine-grained Hallucination Checker and Benchmark for Large Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2405.14486 |