Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2310.07300 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912713587818496 |
|---|---|
| author | Batch, Andrea Ji, Yipeng Fan, Mingming Zhao, Jian Elmqvist, Niklas |
| author_facet | Batch, Andrea Ji, Yipeng Fan, Mingming Zhao, Jian Elmqvist, Niklas |
| contents | Analyzing user behavior from usability evaluation can be a challenging and time-consuming task, especially as the number of participants and the scale and complexity of the evaluation grows. We propose uxSense, a visual analytics system using machine learning methods to extract user behavior from audio and video recordings as parallel time-stamped data streams. Our implementation draws on pattern recognition, computer vision, natural language processing, and machine learning to extract user sentiment, actions, posture, spoken words, and other features from such recordings. These streams are visualized as parallel timelines in a web-based front-end, enabling the researcher to search, filter, and annotate data across time and space. We present the results of a user study involving professional UX researchers evaluating user data using uxSense. In fact, we used uxSense itself to evaluate their sessions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_07300 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | uxSense: Supporting User Experience Analysis with Visualization and Computer Vision Batch, Andrea Ji, Yipeng Fan, Mingming Zhao, Jian Elmqvist, Niklas Human-Computer Interaction Analyzing user behavior from usability evaluation can be a challenging and time-consuming task, especially as the number of participants and the scale and complexity of the evaluation grows. We propose uxSense, a visual analytics system using machine learning methods to extract user behavior from audio and video recordings as parallel time-stamped data streams. Our implementation draws on pattern recognition, computer vision, natural language processing, and machine learning to extract user sentiment, actions, posture, spoken words, and other features from such recordings. These streams are visualized as parallel timelines in a web-based front-end, enabling the researcher to search, filter, and annotate data across time and space. We present the results of a user study involving professional UX researchers evaluating user data using uxSense. In fact, we used uxSense itself to evaluate their sessions. |
| title | uxSense: Supporting User Experience Analysis with Visualization and Computer Vision |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2310.07300 |