UXAgent: A System for Simulating Usability Testing of Web Design with LLM Agents
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908547541893120 |
|---|---|
| author | Lu, Yuxuan Yao, Bingsheng Gu, Hansu Huang, Jing Wang, Jessie Li, Yang Gesi, Jiri He, Qi Li, Toby Jia-Jun Wang, Dakuo |
| author_facet | Lu, Yuxuan Yao, Bingsheng Gu, Hansu Huang, Jing Wang, Jessie Li, Yang Gesi, Jiri He, Qi Li, Toby Jia-Jun Wang, Dakuo |
| contents | Usability testing is a fundamental research method that user experience (UX) researchers use to evaluate and iterate their new designs. But what about evaluating and iterating the usability testing study design itself? Recent advances in Large Language Model-simulated Agent (LLM Agent) research inspired us to design UXAgent to support UX researchers in evaluating and iterating their study design before they conduct the real human-subject study. Our system features a Persona Generator module, an LLM Agent module, and a Universal Browser Connector module to automatically generate thousands of simulated users and to interactively test the target website. The system also provides a Result Viewer Interface so that the UX researchers can easily review and analyze the generated qualitative (e.g., agents' post-study surveys) and quantitative data (e.g., agents' interaction logs), or even interview agents directly. Through a heuristic evaluation with 16 UX researchers, participants praised the innovation of our system but also expressed concerns about the future of LLM Agent usage in UX studies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_09407 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | UXAgent: A System for Simulating Usability Testing of Web Design with LLM Agents Lu, Yuxuan Yao, Bingsheng Gu, Hansu Huang, Jing Wang, Jessie Li, Yang Gesi, Jiri He, Qi Li, Toby Jia-Jun Wang, Dakuo Computation and Language Human-Computer Interaction Usability testing is a fundamental research method that user experience (UX) researchers use to evaluate and iterate their new designs. But what about evaluating and iterating the usability testing study design itself? Recent advances in Large Language Model-simulated Agent (LLM Agent) research inspired us to design UXAgent to support UX researchers in evaluating and iterating their study design before they conduct the real human-subject study. Our system features a Persona Generator module, an LLM Agent module, and a Universal Browser Connector module to automatically generate thousands of simulated users and to interactively test the target website. The system also provides a Result Viewer Interface so that the UX researchers can easily review and analyze the generated qualitative (e.g., agents' post-study surveys) and quantitative data (e.g., agents' interaction logs), or even interview agents directly. Through a heuristic evaluation with 16 UX researchers, participants praised the innovation of our system but also expressed concerns about the future of LLM Agent usage in UX studies. |
| title | UXAgent: A System for Simulating Usability Testing of Web Design with LLM Agents |
| topic | Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2504.09407 |