Can Community Notes Replace Professional Fact-Checkers?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Borenstein, Nadav, Warren, Greta, Elliott, Desmond, Augenstein, Isabelle
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912397059424256
author Borenstein, Nadav
Warren, Greta
Elliott, Desmond
Augenstein, Isabelle
author_facet Borenstein, Nadav
Warren, Greta
Elliott, Desmond
Augenstein, Isabelle
contents Two commonly employed strategies to combat the rise of misinformation on social media are (i) fact-checking by professional organisations and (ii) community moderation by platform users. Policy changes by Twitter/X and, more recently, Meta, signal a shift away from partnerships with fact-checking organisations and towards an increased reliance on crowdsourced community notes. However, the extent and nature of dependencies between fact-checking and helpful community notes remain unclear. To address these questions, we use language models to annotate a large corpus of Twitter/X community notes with attributes such as topic, cited sources, and whether they refute claims tied to broader misinformation narratives. Our analysis reveals that community notes cite fact-checking sources up to five times more than previously reported. Fact-checking is especially crucial for notes on posts linked to broader narratives, which are twice as likely to reference fact-checking sources compared to other sources. Our results show that successful community moderation relies on professional fact-checking and highlight how citizen and professional fact-checking are deeply intertwined.
format Preprint
id arxiv_https___arxiv_org_abs_2502_14132
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Can Community Notes Replace Professional Fact-Checkers?
Borenstein, Nadav
Warren, Greta
Elliott, Desmond
Augenstein, Isabelle
Computation and Language
Artificial Intelligence
Two commonly employed strategies to combat the rise of misinformation on social media are (i) fact-checking by professional organisations and (ii) community moderation by platform users. Policy changes by Twitter/X and, more recently, Meta, signal a shift away from partnerships with fact-checking organisations and towards an increased reliance on crowdsourced community notes. However, the extent and nature of dependencies between fact-checking and helpful community notes remain unclear. To address these questions, we use language models to annotate a large corpus of Twitter/X community notes with attributes such as topic, cited sources, and whether they refute claims tied to broader misinformation narratives. Our analysis reveals that community notes cite fact-checking sources up to five times more than previously reported. Fact-checking is especially crucial for notes on posts linked to broader narratives, which are twice as likely to reference fact-checking sources compared to other sources. Our results show that successful community moderation relies on professional fact-checking and highlight how citizen and professional fact-checking are deeply intertwined.
title Can Community Notes Replace Professional Fact-Checkers?
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2502.14132