Overview of Factify5WQA: Fact Verification through 5W Question-Answering
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909337103892480 |
|---|---|
| author | Suresh, Suryavardan Rani, Anku Patwa, Parth Reganti, Aishwarya Jain, Vinija Chadha, Aman Das, Amitava Sheth, Amit Ekbal, Asif |
| author_facet | Suresh, Suryavardan Rani, Anku Patwa, Parth Reganti, Aishwarya Jain, Vinija Chadha, Aman Das, Amitava Sheth, Amit Ekbal, Asif |
| contents | Researchers have found that fake news spreads much times faster than real news. This is a major problem, especially in today's world where social media is the key source of news for many among the younger population. Fact verification, thus, becomes an important task and many media sites contribute to the cause. Manual fact verification is a tedious task, given the volume of fake news online. The Factify5WQA shared task aims to increase research towards automated fake news detection by providing a dataset with an aspect-based question answering based fact verification method. Each claim and its supporting document is associated with 5W questions that help compare the two information sources. The objective performance measure in the task is done by comparing answers using BLEU score to measure the accuracy of the answers, followed by an accuracy measure of the classification. The task had submissions using custom training setup and pre-trained language-models among others. The best performing team posted an accuracy of 69.56%, which is a near 35% improvement over the baseline. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_04236 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Overview of Factify5WQA: Fact Verification through 5W Question-Answering Suresh, Suryavardan Rani, Anku Patwa, Parth Reganti, Aishwarya Jain, Vinija Chadha, Aman Das, Amitava Sheth, Amit Ekbal, Asif Computation and Language Artificial Intelligence Machine Learning Researchers have found that fake news spreads much times faster than real news. This is a major problem, especially in today's world where social media is the key source of news for many among the younger population. Fact verification, thus, becomes an important task and many media sites contribute to the cause. Manual fact verification is a tedious task, given the volume of fake news online. The Factify5WQA shared task aims to increase research towards automated fake news detection by providing a dataset with an aspect-based question answering based fact verification method. Each claim and its supporting document is associated with 5W questions that help compare the two information sources. The objective performance measure in the task is done by comparing answers using BLEU score to measure the accuracy of the answers, followed by an accuracy measure of the classification. The task had submissions using custom training setup and pre-trained language-models among others. The best performing team posted an accuracy of 69.56%, which is a near 35% improvement over the baseline. |
| title | Overview of Factify5WQA: Fact Verification through 5W Question-Answering |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2410.04236 |