UXAgent: An LLM Agent-Based Usability Testing Framework for Web Design
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910904036098048 |
|---|---|
| author | Lu, Yuxuan Yao, Bingsheng Gu, Hansu Huang, Jing Wang, Jessie Li, Yang Gesi, Jiri He, Qi Li, Toby Jia-Jun Wang, Dakuo |
| author_facet | Lu, Yuxuan Yao, Bingsheng Gu, Hansu Huang, Jing Wang, Jessie Li, Yang Gesi, Jiri He, Qi Li, Toby Jia-Jun Wang, Dakuo |
| contents | Usability testing is a fundamental yet challenging (e.g., inflexible to iterate the study design flaws and hard to recruit study participants) research method for user experience (UX) researchers to evaluate a web design. Recent advances in Large Language Model-simulated Agent (LLM-Agent) research inspired us to design UXAgent to support UX researchers in evaluating and reiterating their usability testing study design before they conduct the real human subject study. Our system features an LLM-Agent module and a universal browser connector module so that UX researchers can automatically generate thousands of simulated users to test the target website. The results are shown in qualitative (e.g., interviewing how an agent thinks ), quantitative (e.g., # of actions), and video recording formats for UX researchers to analyze. Through a heuristic user evaluation with five UX researchers, participants praised the innovation of our system but also expressed concerns about the future of LLM Agent-assisted UX study. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_12561 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | UXAgent: An LLM Agent-Based Usability Testing Framework for Web Design Lu, Yuxuan Yao, Bingsheng Gu, Hansu Huang, Jing Wang, Jessie Li, Yang Gesi, Jiri He, Qi Li, Toby Jia-Jun Wang, Dakuo Human-Computer Interaction Computation and Language Usability testing is a fundamental yet challenging (e.g., inflexible to iterate the study design flaws and hard to recruit study participants) research method for user experience (UX) researchers to evaluate a web design. Recent advances in Large Language Model-simulated Agent (LLM-Agent) research inspired us to design UXAgent to support UX researchers in evaluating and reiterating their usability testing study design before they conduct the real human subject study. Our system features an LLM-Agent module and a universal browser connector module so that UX researchers can automatically generate thousands of simulated users to test the target website. The results are shown in qualitative (e.g., interviewing how an agent thinks ), quantitative (e.g., # of actions), and video recording formats for UX researchers to analyze. Through a heuristic user evaluation with five UX researchers, participants praised the innovation of our system but also expressed concerns about the future of LLM Agent-assisted UX study. |
| title | UXAgent: An LLM Agent-Based Usability Testing Framework for Web Design |
| topic | Human-Computer Interaction Computation and Language |
| url | https://arxiv.org/abs/2502.12561 |