Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2408.15171 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917760110428160 |
|---|---|
| author | Kriman, N. E. |
| author_facet | Kriman, N. E. |
| contents | The use of large language models (LLMs) has significantly increased since the introduction of ChatGPT in 2022, demonstrating their value across various applications. However, a major challenge for enterprise and commercial adoption of LLMs is their tendency to generate inaccurate information, a phenomenon known as "hallucination." This project proposes a method for estimating the factuality of a summary generated by LLMs when compared to a source text. Our approach utilizes Naive Bayes classification to assess the accuracy of the content produced. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_15171 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Measuring text summarization factuality using atomic facts entailment metrics in the context of retrieval augmented generation Kriman, N. E. Computation and Language 68T50 I.2.7 The use of large language models (LLMs) has significantly increased since the introduction of ChatGPT in 2022, demonstrating their value across various applications. However, a major challenge for enterprise and commercial adoption of LLMs is their tendency to generate inaccurate information, a phenomenon known as "hallucination." This project proposes a method for estimating the factuality of a summary generated by LLMs when compared to a source text. Our approach utilizes Naive Bayes classification to assess the accuracy of the content produced. |
| title | Measuring text summarization factuality using atomic facts entailment metrics in the context of retrieval augmented generation |
| topic | Computation and Language 68T50 I.2.7 |
| url | https://arxiv.org/abs/2408.15171 |