Affording Process Auditability with QualAnalyzer: An Atomistic LLM Analysis Tool for Qualitative Research
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910103110680576 |
|---|---|
| author | Lu, Max Hao Ellegood, Ryan Rodriguez-Ramirez, Rony Blumert, Sophia |
| author_facet | Lu, Max Hao Ellegood, Ryan Rodriguez-Ramirez, Rony Blumert, Sophia |
| contents | Large language models are increasingly used for qualitative data analysis, but many workflows obscure how analytic conclusions are produced. We present QualAnalyzer, an open-source Chrome extension for Google Workspace that supports atomistic LLM analysis by processing each data segment independently and preserving the prompt, input, and output for every unit. Through two case studies -- holistic essay scoring and deductive thematic coding of interview transcripts -- we show that this approach creates a legible audit trail and helps researchers investigate systematic differences between LLM and human judgments. We argue that process auditability is essential for making LLM-assisted qualitative research more transparent and methodologically robust. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_03820 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Affording Process Auditability with QualAnalyzer: An Atomistic LLM Analysis Tool for Qualitative Research Lu, Max Hao Ellegood, Ryan Rodriguez-Ramirez, Rony Blumert, Sophia Artificial Intelligence Computation and Language Large language models are increasingly used for qualitative data analysis, but many workflows obscure how analytic conclusions are produced. We present QualAnalyzer, an open-source Chrome extension for Google Workspace that supports atomistic LLM analysis by processing each data segment independently and preserving the prompt, input, and output for every unit. Through two case studies -- holistic essay scoring and deductive thematic coding of interview transcripts -- we show that this approach creates a legible audit trail and helps researchers investigate systematic differences between LLM and human judgments. We argue that process auditability is essential for making LLM-assisted qualitative research more transparent and methodologically robust. |
| title | Affording Process Auditability with QualAnalyzer: An Atomistic LLM Analysis Tool for Qualitative Research |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2604.03820 |