Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912801209974784 |
|---|---|
| author | Rahman, Subhey Sadi Islam, Md. Adnanul Alam, Md. Mahbub Zeba, Musarrat Rahman, Md. Abdur Chowa, Sadia Sultana Raiaan, Mohaimenul Azam Khan Azam, Sami |
| author_facet | Rahman, Subhey Sadi Islam, Md. Adnanul Alam, Md. Mahbub Zeba, Musarrat Rahman, Md. Abdur Chowa, Sadia Sultana Raiaan, Mohaimenul Azam Khan Azam, Sami |
| contents | Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review systematically analyzes how LLM-generated content is evaluated for factual accuracy by exploring key challenges such as hallucinations, dataset limitations, and the reliability of evaluation metrics. The review emphasizes the need for strong fact-checking frameworks that integrate advanced prompting strategies, domain-specific fine-tuning, and retrieval-augmented generation (RAG) methods. It proposes five research questions that guide the analysis of the recent literature from 2020 to 2025, focusing on evaluation methods and mitigation techniques. Instruction tuning, multi-agent reasoning, and RAG frameworks for external knowledge access are also reviewed. The key findings demonstrate the limitations of current metrics, the importance of validated external evidence, and the improvement of factual consistency through domain-specific customization. The review underscores the importance of building more accurate, understandable, and context-aware fact-checking. These insights contribute to the advancement of research toward more trustworthy models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_03860 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models Rahman, Subhey Sadi Islam, Md. Adnanul Alam, Md. Mahbub Zeba, Musarrat Rahman, Md. Abdur Chowa, Sadia Sultana Raiaan, Mohaimenul Azam Khan Azam, Sami Computation and Language Artificial Intelligence Machine Learning Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review systematically analyzes how LLM-generated content is evaluated for factual accuracy by exploring key challenges such as hallucinations, dataset limitations, and the reliability of evaluation metrics. The review emphasizes the need for strong fact-checking frameworks that integrate advanced prompting strategies, domain-specific fine-tuning, and retrieval-augmented generation (RAG) methods. It proposes five research questions that guide the analysis of the recent literature from 2020 to 2025, focusing on evaluation methods and mitigation techniques. Instruction tuning, multi-agent reasoning, and RAG frameworks for external knowledge access are also reviewed. The key findings demonstrate the limitations of current metrics, the importance of validated external evidence, and the improvement of factual consistency through domain-specific customization. The review underscores the importance of building more accurate, understandable, and context-aware fact-checking. These insights contribute to the advancement of research toward more trustworthy models. |
| title | Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2508.03860 |