A Novel, Human-in-the-Loop Computational Grounded Theory Framework for Big Social Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Alqazlan, Lama, Fang, Zheng, Castelle, Michael, Procter, Rob
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918047543984128
author Alqazlan, Lama
Fang, Zheng
Castelle, Michael
Procter, Rob
author_facet Alqazlan, Lama
Fang, Zheng
Castelle, Michael
Procter, Rob
contents The availability of big data has significantly influenced the possibilities and methodological choices for conducting large-scale behavioural and social science research. In the context of qualitative data analysis, a major challenge is that conventional methods require intensive manual labour and are often impractical to apply to large datasets. One effective way to address this issue is by integrating emerging computational methods to overcome scalability limitations. However, a critical concern for researchers is the trustworthiness of results when Machine Learning (ML) and Natural Language Processing (NLP) tools are used to analyse such data. We argue that confidence in the credibility and robustness of results depends on adopting a 'human-in-the-loop' methodology that is able to provide researchers with control over the analytical process, while retaining the benefits of using ML and NLP. With this in mind, we propose a novel methodological framework for Computational Grounded Theory (CGT) that supports the analysis of large qualitative datasets, while maintaining the rigour of established Grounded Theory (GT) methodologies. To illustrate the framework's value, we present the results of testing it on a dataset collected from Reddit in a study aimed at understanding tutors' experiences in the gig economy.
format Preprint
id arxiv_https___arxiv_org_abs_2506_06083
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Novel, Human-in-the-Loop Computational Grounded Theory Framework for Big Social Data
Alqazlan, Lama
Fang, Zheng
Castelle, Michael
Procter, Rob
Human-Computer Interaction
Information Retrieval
Machine Learning
H.4; I.7; J.4
The availability of big data has significantly influenced the possibilities and methodological choices for conducting large-scale behavioural and social science research. In the context of qualitative data analysis, a major challenge is that conventional methods require intensive manual labour and are often impractical to apply to large datasets. One effective way to address this issue is by integrating emerging computational methods to overcome scalability limitations. However, a critical concern for researchers is the trustworthiness of results when Machine Learning (ML) and Natural Language Processing (NLP) tools are used to analyse such data. We argue that confidence in the credibility and robustness of results depends on adopting a 'human-in-the-loop' methodology that is able to provide researchers with control over the analytical process, while retaining the benefits of using ML and NLP. With this in mind, we propose a novel methodological framework for Computational Grounded Theory (CGT) that supports the analysis of large qualitative datasets, while maintaining the rigour of established Grounded Theory (GT) methodologies. To illustrate the framework's value, we present the results of testing it on a dataset collected from Reddit in a study aimed at understanding tutors' experiences in the gig economy.
title A Novel, Human-in-the-Loop Computational Grounded Theory Framework for Big Social Data
topic Human-Computer Interaction
Information Retrieval
Machine Learning
H.4; I.7; J.4
url https://arxiv.org/abs/2506.06083