Saved in:
Bibliographic Details
Main Authors: Zhu, Jessica H., Stringfield, Shayla, Zaprosyan, Vahe, Wagner, Michael, Cukier, Michel, Richardson Jr, Joseph B.
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.16132
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908974183350272
author Zhu, Jessica H.
Stringfield, Shayla
Zaprosyan, Vahe
Wagner, Michael
Cukier, Michel
Richardson Jr, Joseph B.
author_facet Zhu, Jessica H.
Stringfield, Shayla
Zaprosyan, Vahe
Wagner, Michael
Cukier, Michel
Richardson Jr, Joseph B.
contents Firearm violence is a pressing public health issue, yet research into survivors' lived experiences remains underfunded and difficult to scale. Qualitative research, including in-depth interviews, is a valuable tool for understanding the personal and societal consequences of community firearm violence and designing effective interventions. However, manually analyzing these narratives through thematic analysis and inductive coding is time-consuming and labor-intensive. Recent advancements in large language models (LLMs) have opened the door to automating this process, though concerns remain about whether these models can accurately and ethically capture the experiences of vulnerable populations. In this study, we assess the use of open-source LLMs to inductively code interviews with 21 Black men who have survived community firearm violence. Our results demonstrate that while some configurations of LLMs can identify important codes, overall relevance remains low and is highly sensitive to data processing. Furthermore, LLM guardrails lead to substantial narrative erasure. These findings highlight both the potential and limitations of LLM-assisted qualitative coding and underscore the ethical challenges of applying AI in research involving marginalized communities.
format Preprint
id arxiv_https___arxiv_org_abs_2604_16132
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Can LLMs Understand the Impact of Trauma? Costs and Benefits of LLMs Coding the Interviews of Firearm Violence Survivors
Zhu, Jessica H.
Stringfield, Shayla
Zaprosyan, Vahe
Wagner, Michael
Cukier, Michel
Richardson Jr, Joseph B.
Computation and Language
Artificial Intelligence
Firearm violence is a pressing public health issue, yet research into survivors' lived experiences remains underfunded and difficult to scale. Qualitative research, including in-depth interviews, is a valuable tool for understanding the personal and societal consequences of community firearm violence and designing effective interventions. However, manually analyzing these narratives through thematic analysis and inductive coding is time-consuming and labor-intensive. Recent advancements in large language models (LLMs) have opened the door to automating this process, though concerns remain about whether these models can accurately and ethically capture the experiences of vulnerable populations. In this study, we assess the use of open-source LLMs to inductively code interviews with 21 Black men who have survived community firearm violence. Our results demonstrate that while some configurations of LLMs can identify important codes, overall relevance remains low and is highly sensitive to data processing. Furthermore, LLM guardrails lead to substantial narrative erasure. These findings highlight both the potential and limitations of LLM-assisted qualitative coding and underscore the ethical challenges of applying AI in research involving marginalized communities.
title Can LLMs Understand the Impact of Trauma? Costs and Benefits of LLMs Coding the Interviews of Firearm Violence Survivors
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2604.16132