Saved in:
Bibliographic Details
Main Authors: Hagen, Tim, Deckers, Niklas, Wolter, Felix, Scells, Harrisen, Potthast, Martin
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.08224
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909983007834112
author Hagen, Tim
Deckers, Niklas
Wolter, Felix
Scells, Harrisen
Potthast, Martin
author_facet Hagen, Tim
Deckers, Niklas
Wolter, Felix
Scells, Harrisen
Potthast, Martin
contents Many causal claims, such as "sugar causes hyperactivity," are disputed or outdated. Yet research on causality extraction from text has almost entirely neglected counterclaims of causation. To close this gap, we conduct a thorough literature review of causality extraction, compile an extensive inventory of linguistic realizations of countercausal claims, and develop rigorous annotation guidelines that explicitly incorporate countercausal language. We also highlight how counterclaims of causation are an integral part of causal reasoning. Based on our guidelines, we construct a new dataset comprising 1028 causal claims, 952 counterclaims, and 1435 uncausal statements, achieving substantial inter-annotator agreement (Cohen's $κ= 0.74$). In our experiments, state-of-the-art models trained solely on causal claims misclassify counterclaims more than 10 times as often as models trained on our dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2510_08224
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Investigating Counterclaims in Causality Extraction from Text
Hagen, Tim
Deckers, Niklas
Wolter, Felix
Scells, Harrisen
Potthast, Martin
Computation and Language
Machine Learning
Many causal claims, such as "sugar causes hyperactivity," are disputed or outdated. Yet research on causality extraction from text has almost entirely neglected counterclaims of causation. To close this gap, we conduct a thorough literature review of causality extraction, compile an extensive inventory of linguistic realizations of countercausal claims, and develop rigorous annotation guidelines that explicitly incorporate countercausal language. We also highlight how counterclaims of causation are an integral part of causal reasoning. Based on our guidelines, we construct a new dataset comprising 1028 causal claims, 952 counterclaims, and 1435 uncausal statements, achieving substantial inter-annotator agreement (Cohen's $κ= 0.74$). In our experiments, state-of-the-art models trained solely on causal claims misclassify counterclaims more than 10 times as often as models trained on our dataset.
title Investigating Counterclaims in Causality Extraction from Text
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2510.08224