Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2402.13025 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908407418585088 |
|---|---|
| author | Lin, Ying-Jia Lin, Chun-Yi Yeh, Chia-Jen Li, Yi-Ting Hu, Yun-Yu Hsu, Chih-Hao Lee, Mei-Feng Kao, Hung-Yu |
| author_facet | Lin, Ying-Jia Lin, Chun-Yi Yeh, Chia-Jen Li, Yi-Ting Hu, Yun-Yu Hsu, Chih-Hao Lee, Mei-Feng Kao, Hung-Yu |
| contents | We present CFEVER, a Chinese dataset designed for Fact Extraction and VERification. CFEVER comprises 30,012 manually created claims based on content in Chinese Wikipedia. Each claim in CFEVER is labeled as "Supports", "Refutes", or "Not Enough Info" to depict its degree of factualness. Similar to the FEVER dataset, claims in the "Supports" and "Refutes" categories are also annotated with corresponding evidence sentences sourced from single or multiple pages in Chinese Wikipedia. Our labeled dataset holds a Fleiss' kappa value of 0.7934 for five-way inter-annotator agreement. In addition, through the experiments with the state-of-the-art approaches developed on the FEVER dataset and a simple baseline for CFEVER, we demonstrate that our dataset is a new rigorous benchmark for factual extraction and verification, which can be further used for developing automated systems to alleviate human fact-checking efforts. CFEVER is available at https://ikmlab.github.io/CFEVER. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_13025 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CFEVER: A Chinese Fact Extraction and VERification Dataset Lin, Ying-Jia Lin, Chun-Yi Yeh, Chia-Jen Li, Yi-Ting Hu, Yun-Yu Hsu, Chih-Hao Lee, Mei-Feng Kao, Hung-Yu Computation and Language Artificial Intelligence We present CFEVER, a Chinese dataset designed for Fact Extraction and VERification. CFEVER comprises 30,012 manually created claims based on content in Chinese Wikipedia. Each claim in CFEVER is labeled as "Supports", "Refutes", or "Not Enough Info" to depict its degree of factualness. Similar to the FEVER dataset, claims in the "Supports" and "Refutes" categories are also annotated with corresponding evidence sentences sourced from single or multiple pages in Chinese Wikipedia. Our labeled dataset holds a Fleiss' kappa value of 0.7934 for five-way inter-annotator agreement. In addition, through the experiments with the state-of-the-art approaches developed on the FEVER dataset and a simple baseline for CFEVER, we demonstrate that our dataset is a new rigorous benchmark for factual extraction and verification, which can be further used for developing automated systems to alleviate human fact-checking efforts. CFEVER is available at https://ikmlab.github.io/CFEVER. |
| title | CFEVER: A Chinese Fact Extraction and VERification Dataset |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2402.13025 |