Explainable AI Components for Narrative Map Extraction

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Keith, Brian, German, Fausto, Krokos, Eric, Joseph, Sarah, North, Chris
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908276666400768
author Keith, Brian
German, Fausto
Krokos, Eric
Joseph, Sarah
North, Chris
author_facet Keith, Brian
German, Fausto
Krokos, Eric
Joseph, Sarah
North, Chris
contents As narrative extraction systems grow in complexity, establishing user trust through interpretable and explainable outputs becomes increasingly critical. This paper presents an evaluation of an Explainable Artificial Intelligence (XAI) system for narrative map extraction that provides meaningful explanations across multiple levels of abstraction. Our system integrates explanations based on topical clusters for low-level document relationships, connection explanations for event relationships, and high-level structure explanations for overall narrative patterns. In particular, we evaluate the XAI system through a user study involving 10 participants that examined narratives from the 2021 Cuban protests. The analysis of results demonstrates that participants using the explanations made the users trust in the system's decisions, with connection explanations and important event detection proving particularly effective at building user confidence. Survey responses indicate that the multi-level explanation approach helped users develop appropriate trust in the system's narrative extraction capabilities. This work advances the state-of-the-art in explainable narrative extraction while providing practical insights for developing reliable narrative extraction systems that support effective human-AI collaboration.
format Preprint
id arxiv_https___arxiv_org_abs_2503_16554
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Explainable AI Components for Narrative Map Extraction
Keith, Brian
German, Fausto
Krokos, Eric
Joseph, Sarah
North, Chris
Computation and Language
Human-Computer Interaction
As narrative extraction systems grow in complexity, establishing user trust through interpretable and explainable outputs becomes increasingly critical. This paper presents an evaluation of an Explainable Artificial Intelligence (XAI) system for narrative map extraction that provides meaningful explanations across multiple levels of abstraction. Our system integrates explanations based on topical clusters for low-level document relationships, connection explanations for event relationships, and high-level structure explanations for overall narrative patterns. In particular, we evaluate the XAI system through a user study involving 10 participants that examined narratives from the 2021 Cuban protests. The analysis of results demonstrates that participants using the explanations made the users trust in the system's decisions, with connection explanations and important event detection proving particularly effective at building user confidence. Survey responses indicate that the multi-level explanation approach helped users develop appropriate trust in the system's narrative extraction capabilities. This work advances the state-of-the-art in explainable narrative extraction while providing practical insights for developing reliable narrative extraction systems that support effective human-AI collaboration.
title Explainable AI Components for Narrative Map Extraction
topic Computation and Language
Human-Computer Interaction
url https://arxiv.org/abs/2503.16554