Saved in:
Bibliographic Details
Main Authors: Lu, Max Hao, Ellegood, Ryan, Rodriguez-Ramirez, Rony, Blumert, Sophia
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.03820
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910103110680576
author Lu, Max Hao
Ellegood, Ryan
Rodriguez-Ramirez, Rony
Blumert, Sophia
author_facet Lu, Max Hao
Ellegood, Ryan
Rodriguez-Ramirez, Rony
Blumert, Sophia
contents Large language models are increasingly used for qualitative data analysis, but many workflows obscure how analytic conclusions are produced. We present QualAnalyzer, an open-source Chrome extension for Google Workspace that supports atomistic LLM analysis by processing each data segment independently and preserving the prompt, input, and output for every unit. Through two case studies -- holistic essay scoring and deductive thematic coding of interview transcripts -- we show that this approach creates a legible audit trail and helps researchers investigate systematic differences between LLM and human judgments. We argue that process auditability is essential for making LLM-assisted qualitative research more transparent and methodologically robust.
format Preprint
id arxiv_https___arxiv_org_abs_2604_03820
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Affording Process Auditability with QualAnalyzer: An Atomistic LLM Analysis Tool for Qualitative Research
Lu, Max Hao
Ellegood, Ryan
Rodriguez-Ramirez, Rony
Blumert, Sophia
Artificial Intelligence
Computation and Language
Large language models are increasingly used for qualitative data analysis, but many workflows obscure how analytic conclusions are produced. We present QualAnalyzer, an open-source Chrome extension for Google Workspace that supports atomistic LLM analysis by processing each data segment independently and preserving the prompt, input, and output for every unit. Through two case studies -- holistic essay scoring and deductive thematic coding of interview transcripts -- we show that this approach creates a legible audit trail and helps researchers investigate systematic differences between LLM and human judgments. We argue that process auditability is essential for making LLM-assisted qualitative research more transparent and methodologically robust.
title Affording Process Auditability with QualAnalyzer: An Atomistic LLM Analysis Tool for Qualitative Research
topic Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2604.03820