Automated Thematic Analysis for Clinical Qualitative Data: Iterative Codebook Refinement with Full Provenance

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yi, Seungjun, Nguyen, Joakim, Xu, Huimin, Lim, Terence, Skrovan, Joseph, Beri, Mehak, Modi, Hitakshi, Well, Andrew, Mery, Carlos M., Zhang, Yan, Markey, Mia K., Ding, Ying
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910047174393856
author Yi, Seungjun
Nguyen, Joakim
Xu, Huimin
Lim, Terence
Skrovan, Joseph
Beri, Mehak
Modi, Hitakshi
Well, Andrew
Mery, Carlos M.
Zhang, Yan
Markey, Mia K.
Ding, Ying
author_facet Yi, Seungjun
Nguyen, Joakim
Xu, Huimin
Lim, Terence
Skrovan, Joseph
Beri, Mehak
Modi, Hitakshi
Well, Andrew
Mery, Carlos M.
Zhang, Yan
Markey, Mia K.
Ding, Ying
contents Thematic analysis (TA) is widely used in health research to extract patterns from patient interviews, yet manual TA faces challenges in scalability and reproducibility. LLM-based automation can help, but existing approaches produce codebooks with limited generalizability and lack analytic auditability. We present an automated TA framework combining iterative codebook refinement with full provenance tracking. Evaluated on five corpora spanning clinical interviews, social media, and public transcripts, the framework achieves the highest composite quality score on four of five datasets compared to six baselines. Iterative refinement yields statistically significant improvements on four datasets with large effect sizes, driven by gains in code reusability and distributional consistency while preserving descriptive quality. On two clinical corpora (pediatric cardiology), generated themes align with expert-annotated themes.
format Preprint
id arxiv_https___arxiv_org_abs_2603_08989
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Automated Thematic Analysis for Clinical Qualitative Data: Iterative Codebook Refinement with Full Provenance
Yi, Seungjun
Nguyen, Joakim
Xu, Huimin
Lim, Terence
Skrovan, Joseph
Beri, Mehak
Modi, Hitakshi
Well, Andrew
Mery, Carlos M.
Zhang, Yan
Markey, Mia K.
Ding, Ying
Computation and Language
Thematic analysis (TA) is widely used in health research to extract patterns from patient interviews, yet manual TA faces challenges in scalability and reproducibility. LLM-based automation can help, but existing approaches produce codebooks with limited generalizability and lack analytic auditability. We present an automated TA framework combining iterative codebook refinement with full provenance tracking. Evaluated on five corpora spanning clinical interviews, social media, and public transcripts, the framework achieves the highest composite quality score on four of five datasets compared to six baselines. Iterative refinement yields statistically significant improvements on four datasets with large effect sizes, driven by gains in code reusability and distributional consistency while preserving descriptive quality. On two clinical corpora (pediatric cardiology), generated themes align with expert-annotated themes.
title Automated Thematic Analysis for Clinical Qualitative Data: Iterative Codebook Refinement with Full Provenance
topic Computation and Language
url https://arxiv.org/abs/2603.08989