FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914671557083136 |
|---|---|
| author | Choi, Eun Cheol Ferrara, Emilio |
| author_facet | Choi, Eun Cheol Ferrara, Emilio |
| contents | Our society is facing rampant misinformation harming public health and trust. To address the societal challenge, we introduce FACT-GPT, a system leveraging Large Language Models (LLMs) to automate the claim matching stage of fact-checking. FACT-GPT, trained on a synthetic dataset, identifies social media content that aligns with, contradicts, or is irrelevant to previously debunked claims. Our evaluation shows that our specialized LLMs can match the accuracy of larger models in identifying related claims, closely mirroring human judgment. This research provides an automated solution for efficient claim matching, demonstrates the potential of LLMs in supporting fact-checkers, and offers valuable resources for further research in the field. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_05904 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs Choi, Eun Cheol Ferrara, Emilio Computation and Language Computers and Society Human-Computer Interaction Social and Information Networks Our society is facing rampant misinformation harming public health and trust. To address the societal challenge, we introduce FACT-GPT, a system leveraging Large Language Models (LLMs) to automate the claim matching stage of fact-checking. FACT-GPT, trained on a synthetic dataset, identifies social media content that aligns with, contradicts, or is irrelevant to previously debunked claims. Our evaluation shows that our specialized LLMs can match the accuracy of larger models in identifying related claims, closely mirroring human judgment. This research provides an automated solution for efficient claim matching, demonstrates the potential of LLMs in supporting fact-checkers, and offers valuable resources for further research in the field. |
| title | FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs |
| topic | Computation and Language Computers and Society Human-Computer Interaction Social and Information Networks |
| url | https://arxiv.org/abs/2402.05904 |