Effects of Collaboration on the Performance of Interactive Theme Discovery Systems
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911609130057728 |
|---|---|
| author | Chen, Alvin Po-Chun Das, Rohan Srinivas, Dananjay Barry, Alexandra Seniw, Maksim Pacheco, Maria Leonor |
| author_facet | Chen, Alvin Po-Chun Das, Rohan Srinivas, Dananjay Barry, Alexandra Seniw, Maksim Pacheco, Maria Leonor |
| contents | NLP-assisted solutions to support qualitative data analysis have gained considerable traction. However, no unified evaluation framework exists which can account for the many different settings in which qualitative researchers may employ them. In this paper, we propose a framework to evaluate the way collaboration settings may produce different research outcomes across a variety of interactive systems. Specifically, we study the impact of synchronous vs. asynchronous collaboration using three different NLP-assisted qualitative research tools and present a comprehensive analysis of the differences in the consistency, cohesiveness, and correctness of their outcomes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_09030 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Effects of Collaboration on the Performance of Interactive Theme Discovery Systems Chen, Alvin Po-Chun Das, Rohan Srinivas, Dananjay Barry, Alexandra Seniw, Maksim Pacheco, Maria Leonor Computation and Language Human-Computer Interaction NLP-assisted solutions to support qualitative data analysis have gained considerable traction. However, no unified evaluation framework exists which can account for the many different settings in which qualitative researchers may employ them. In this paper, we propose a framework to evaluate the way collaboration settings may produce different research outcomes across a variety of interactive systems. Specifically, we study the impact of synchronous vs. asynchronous collaboration using three different NLP-assisted qualitative research tools and present a comprehensive analysis of the differences in the consistency, cohesiveness, and correctness of their outcomes. |
| title | Effects of Collaboration on the Performance of Interactive Theme Discovery Systems |
| topic | Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2408.09030 |