TruthStance: An Annotated Dataset of Conversations on Truth Social

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Ameen, Fathima, Brown, Danielle, Malgareddy, Manusha, Haque, Amanul
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917275720744960
author Ameen, Fathima
Brown, Danielle
Malgareddy, Manusha
Haque, Amanul
author_facet Ameen, Fathima
Brown, Danielle
Malgareddy, Manusha
Haque, Amanul
contents Argument mining and stance detection are central to understanding how opinions are formed and contested in online discourse. However, most publicly available resources focus on mainstream platforms such as Twitter and Reddit, leaving conversational structure on alt-tech platforms comparatively under-studied. We introduce TruthStance, a large-scale dataset of Truth Social conversation threads spanning 2023-2025, consisting of 24,378 posts and 523,360 comments with reply-tree structure preserved. We provide a human-annotated benchmark of 1,500 instances across argument mining and claim-based stance detection, including inter-annotator agreement, and use it to evaluate large language model (LLM) prompting strategies. Using the best-performing configuration, we release additional LLM-generated labels for 24,352 posts (argument presence) and 107,873 comments (stance to parent), enabling analysis of stance and argumentation patterns across depth, topics, and users. All code and data are released publicly.
format Preprint
id arxiv_https___arxiv_org_abs_2602_14406
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle TruthStance: An Annotated Dataset of Conversations on Truth Social
Ameen, Fathima
Brown, Danielle
Malgareddy, Manusha
Haque, Amanul
Computation and Language
Artificial Intelligence
Argument mining and stance detection are central to understanding how opinions are formed and contested in online discourse. However, most publicly available resources focus on mainstream platforms such as Twitter and Reddit, leaving conversational structure on alt-tech platforms comparatively under-studied. We introduce TruthStance, a large-scale dataset of Truth Social conversation threads spanning 2023-2025, consisting of 24,378 posts and 523,360 comments with reply-tree structure preserved. We provide a human-annotated benchmark of 1,500 instances across argument mining and claim-based stance detection, including inter-annotator agreement, and use it to evaluate large language model (LLM) prompting strategies. Using the best-performing configuration, we release additional LLM-generated labels for 24,352 posts (argument presence) and 107,873 comments (stance to parent), enabling analysis of stance and argumentation patterns across depth, topics, and users. All code and data are released publicly.
title TruthStance: An Annotated Dataset of Conversations on Truth Social
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2602.14406