Qualitative Coding Analysis through Open-Source Large Language Models: A User Study and Design Recommendations
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912916029046784 |
|---|---|
| author | Ngo, Tung T. Van, Dai Nguyen Nguyen, Anh-Minh Do, Phuong-Anh Nguyen-Quoc, Anh |
| author_facet | Ngo, Tung T. Van, Dai Nguyen Nguyen, Anh-Minh Do, Phuong-Anh Nguyen-Quoc, Anh |
| contents | Qualitative data analysis is labor-intensive, yet the privacy risks associated with commercial Large Language Models (LLMs) often preclude their use in sensitive research. To address this, we introduce ChatQDA, an on-device framework powered by open-source LLMs designed for privacy-preserving open coding. Our mixed-methods user study reveals that while participants rated the system highly for usability and perceived efficiency, they exhibited "conditional trust", valuing the tool for surface-level extraction while questioning its interpretive nuance and consistency. Furthermore, despite the technical security of local deployment, participants reported epistemic uncertainty regarding data protection, suggesting that invisible security measures are insufficient to foster trust. We conclude with design recommendations for local-first analysis tools that prioritize verifiable privacy and methodological rigor. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_18352 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Qualitative Coding Analysis through Open-Source Large Language Models: A User Study and Design Recommendations Ngo, Tung T. Van, Dai Nguyen Nguyen, Anh-Minh Do, Phuong-Anh Nguyen-Quoc, Anh Human-Computer Interaction Cryptography and Security Software Engineering Qualitative data analysis is labor-intensive, yet the privacy risks associated with commercial Large Language Models (LLMs) often preclude their use in sensitive research. To address this, we introduce ChatQDA, an on-device framework powered by open-source LLMs designed for privacy-preserving open coding. Our mixed-methods user study reveals that while participants rated the system highly for usability and perceived efficiency, they exhibited "conditional trust", valuing the tool for surface-level extraction while questioning its interpretive nuance and consistency. Furthermore, despite the technical security of local deployment, participants reported epistemic uncertainty regarding data protection, suggesting that invisible security measures are insufficient to foster trust. We conclude with design recommendations for local-first analysis tools that prioritize verifiable privacy and methodological rigor. |
| title | Qualitative Coding Analysis through Open-Source Large Language Models: A User Study and Design Recommendations |
| topic | Human-Computer Interaction Cryptography and Security Software Engineering |
| url | https://arxiv.org/abs/2602.18352 |