Usability Analysis of Configurator User Interfaces with Multimodal Large Language Models
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913169793875968 |
|---|---|
| author | Lubos, Sebastian Felfernig, Alexander Garber, Damian Kraljić, Adnan Kraljić, Tarik Le, Viet-Man Tran, Thi Ngoc Trang Leitner, Gerhard Schwazer, Julian Suppan, Doris Willfort, Reinhard Dukic, Ivan Fuchs, Jeremias Henrich, Manuel |
| author_facet | Lubos, Sebastian Felfernig, Alexander Garber, Damian Kraljić, Adnan Kraljić, Tarik Le, Viet-Man Tran, Thi Ngoc Trang Leitner, Gerhard Schwazer, Julian Suppan, Doris Willfort, Reinhard Dukic, Ivan Fuchs, Jeremias Henrich, Manuel |
| contents | Configuration is a key technology for tailoring complex software systems, services, and products. A successful application of configurators not only depends on technical correctness, performance, and domain modeling but also on their usability. While general usability heuristics are widely used, configurator-specific criteria and tool support for systematic user interface (UI) analysis are limited. This paper explores the use of multimodal large language models (MLLMs) for scalable and semi-automated usability analysis of configurator UIs. We synthesize 18 configurator-specific usability criteria from the literature and apply these criteria in an MLLM-based analysis of 16 real-world configurators. Each criterion is assessed individually to generate severity ratings for usability issues and actionable improvement suggestions. A review of the results confirms that MLLMs can reliably identify configurator-specific usability issues and provide domain-aware improvement recommendations. Although human validation remains necessary, this approach has the potential to significantly reduce the required effort to analyze configurator usability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_29456 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Usability Analysis of Configurator User Interfaces with Multimodal Large Language Models Lubos, Sebastian Felfernig, Alexander Garber, Damian Kraljić, Adnan Kraljić, Tarik Le, Viet-Man Tran, Thi Ngoc Trang Leitner, Gerhard Schwazer, Julian Suppan, Doris Willfort, Reinhard Dukic, Ivan Fuchs, Jeremias Henrich, Manuel Software Engineering Human-Computer Interaction Configuration is a key technology for tailoring complex software systems, services, and products. A successful application of configurators not only depends on technical correctness, performance, and domain modeling but also on their usability. While general usability heuristics are widely used, configurator-specific criteria and tool support for systematic user interface (UI) analysis are limited. This paper explores the use of multimodal large language models (MLLMs) for scalable and semi-automated usability analysis of configurator UIs. We synthesize 18 configurator-specific usability criteria from the literature and apply these criteria in an MLLM-based analysis of 16 real-world configurators. Each criterion is assessed individually to generate severity ratings for usability issues and actionable improvement suggestions. A review of the results confirms that MLLMs can reliably identify configurator-specific usability issues and provide domain-aware improvement recommendations. Although human validation remains necessary, this approach has the potential to significantly reduce the required effort to analyze configurator usability. |
| title | Usability Analysis of Configurator User Interfaces with Multimodal Large Language Models |
| topic | Software Engineering Human-Computer Interaction |
| url | https://arxiv.org/abs/2605.29456 |