Qualitative Study for LLM-assisted Design Study Process: Strategies, Challenges, and Roles
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908487433322496 |
|---|---|
| author | Ruan, Shaolun Sheng, Rui Wen, Xiaolin Wang, Jiachen Zhang, Tianyi Wang, Yong Dwyer, Tim Li, Jiannan |
| author_facet | Ruan, Shaolun Sheng, Rui Wen, Xiaolin Wang, Jiachen Zhang, Tianyi Wang, Yong Dwyer, Tim Li, Jiannan |
| contents | Design studies aim to create visualization solutions for real-world problems of different application domains. Recently, the emergence of large language models (LLMs) has introduced new opportunities to enhance the design study process, providing capabilities such as creative problem-solving, data handling, and insightful analysis. However, despite their growing popularity, there remains a lack of systematic understanding of how LLMs can effectively assist researchers in visualization-specific design studies. In this paper, we conducted a multi-stage qualitative study to fill this gap, involving 30 design study researchers from diverse backgrounds and expertise levels. Through in-depth interviews and carefully-designed questionnaires, we investigated strategies for utilizing LLMs, the challenges encountered, and the practices used to overcome them. We further compiled and summarized the roles that LLMs can play across different stages of the design study process. Our findings highlight practical implications to inform visualization practitioners, and provide a framework for leveraging LLMs to enhance the design study process in visualization research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_10024 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Qualitative Study for LLM-assisted Design Study Process: Strategies, Challenges, and Roles Ruan, Shaolun Sheng, Rui Wen, Xiaolin Wang, Jiachen Zhang, Tianyi Wang, Yong Dwyer, Tim Li, Jiannan Human-Computer Interaction Design studies aim to create visualization solutions for real-world problems of different application domains. Recently, the emergence of large language models (LLMs) has introduced new opportunities to enhance the design study process, providing capabilities such as creative problem-solving, data handling, and insightful analysis. However, despite their growing popularity, there remains a lack of systematic understanding of how LLMs can effectively assist researchers in visualization-specific design studies. In this paper, we conducted a multi-stage qualitative study to fill this gap, involving 30 design study researchers from diverse backgrounds and expertise levels. Through in-depth interviews and carefully-designed questionnaires, we investigated strategies for utilizing LLMs, the challenges encountered, and the practices used to overcome them. We further compiled and summarized the roles that LLMs can play across different stages of the design study process. Our findings highlight practical implications to inform visualization practitioners, and provide a framework for leveraging LLMs to enhance the design study process in visualization research. |
| title | Qualitative Study for LLM-assisted Design Study Process: Strategies, Challenges, and Roles |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2507.10024 |