Saved in:
Bibliographic Details
Main Authors: Hosseinichimeh, Niyousha, Majumdar, Aritra, Williams, Ross, Ghaffarzadegan, Navid
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2402.11400
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910335317835776
author Hosseinichimeh, Niyousha
Majumdar, Aritra
Williams, Ross
Ghaffarzadegan, Navid
author_facet Hosseinichimeh, Niyousha
Majumdar, Aritra
Williams, Ross
Ghaffarzadegan, Navid
contents We introduce and test the System Dynamics Bot, a computer program leveraging a large language model to automate the creation of causal loop diagrams from textual data. To evaluate its performance, we ensembled two distinct databases. The first dataset includes 20 causal loop diagrams and associated texts sourced from the system dynamics literature. The second dataset comprises responses from 30 participants to a vignette, along with causal loop diagrams coded by three system dynamics modelers. The bot uses textual data and successfully identifies approximately sixty percent of the links between variables and feedback loops in both datasets. This paper outlines our approach, provides examples, and presents evaluation results. We discuss encountered challenges and implemented solutions in developing the System Dynamics Bot. The bot can facilitate extracting mental models from textual data and improve model building processes. Moreover, the two datasets can serve as a testbed for similar programs.
format Preprint
id arxiv_https___arxiv_org_abs_2402_11400
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle From Text to Map: A System Dynamics Bot for Constructing Causal Loop Diagrams
Hosseinichimeh, Niyousha
Majumdar, Aritra
Williams, Ross
Ghaffarzadegan, Navid
Human-Computer Interaction
We introduce and test the System Dynamics Bot, a computer program leveraging a large language model to automate the creation of causal loop diagrams from textual data. To evaluate its performance, we ensembled two distinct databases. The first dataset includes 20 causal loop diagrams and associated texts sourced from the system dynamics literature. The second dataset comprises responses from 30 participants to a vignette, along with causal loop diagrams coded by three system dynamics modelers. The bot uses textual data and successfully identifies approximately sixty percent of the links between variables and feedback loops in both datasets. This paper outlines our approach, provides examples, and presents evaluation results. We discuss encountered challenges and implemented solutions in developing the System Dynamics Bot. The bot can facilitate extracting mental models from textual data and improve model building processes. Moreover, the two datasets can serve as a testbed for similar programs.
title From Text to Map: A System Dynamics Bot for Constructing Causal Loop Diagrams
topic Human-Computer Interaction
url https://arxiv.org/abs/2402.11400