How Does Users' App Knowledge Influence the Preferred Level of Detail and Format of Software Explanations?

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Obaidi, Martin, Fischbach, Jannik, Herrmann, Marc, Deters, Hannah, Droste, Jakob, Klünder, Jil, Schneider, Kurt
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908410126008320
author Obaidi, Martin
Fischbach, Jannik
Herrmann, Marc
Deters, Hannah
Droste, Jakob
Klünder, Jil
Schneider, Kurt
author_facet Obaidi, Martin
Fischbach, Jannik
Herrmann, Marc
Deters, Hannah
Droste, Jakob
Klünder, Jil
Schneider, Kurt
contents Context and Motivation: Due to their increasing complexity, everyday software systems are becoming increasingly opaque for users. A frequently adopted method to address this difficulty is explainability, which aims to make systems more understandable and usable. Question/problem: However, explanations can also lead to unnecessary cognitive load. Therefore, adapting explanations to the actual needs of a user is a frequently faced challenge. Principal ideas/results: This study investigates factors influencing users' preferred the level of detail and the form of an explanation (e.g., short text or video tutorial) in software. We conducted an online survey with 58 participants to explore relationships between demographics, software usage, app-specific knowledge, as well as their preferred explanation form and level of detail. The results indicate that users prefer moderately detailed explanations in short text formats. Correlation analyses revealed no relationship between app-specific knowledge and the preferred level of detail of an explanation, but an influence of demographic aspects (like gender) on app-specific knowledge and its impact on application confidence were observed, pointing to a possible mediated relationship between knowledge and preferences for explanations. Contribution: Our results show that explanation preferences are weakly influenced by app-specific knowledge but shaped by demographic and psychological factors, supporting the development of adaptive explanation systems tailored to user expertise. These findings support requirements analysis processes by highlighting important factors that should be considered in user-centered methods such as personas.
format Preprint
id arxiv_https___arxiv_org_abs_2502_06549
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle How Does Users' App Knowledge Influence the Preferred Level of Detail and Format of Software Explanations?
Obaidi, Martin
Fischbach, Jannik
Herrmann, Marc
Deters, Hannah
Droste, Jakob
Klünder, Jil
Schneider, Kurt
Software Engineering
Context and Motivation: Due to their increasing complexity, everyday software systems are becoming increasingly opaque for users. A frequently adopted method to address this difficulty is explainability, which aims to make systems more understandable and usable. Question/problem: However, explanations can also lead to unnecessary cognitive load. Therefore, adapting explanations to the actual needs of a user is a frequently faced challenge. Principal ideas/results: This study investigates factors influencing users' preferred the level of detail and the form of an explanation (e.g., short text or video tutorial) in software. We conducted an online survey with 58 participants to explore relationships between demographics, software usage, app-specific knowledge, as well as their preferred explanation form and level of detail. The results indicate that users prefer moderately detailed explanations in short text formats. Correlation analyses revealed no relationship between app-specific knowledge and the preferred level of detail of an explanation, but an influence of demographic aspects (like gender) on app-specific knowledge and its impact on application confidence were observed, pointing to a possible mediated relationship between knowledge and preferences for explanations. Contribution: Our results show that explanation preferences are weakly influenced by app-specific knowledge but shaped by demographic and psychological factors, supporting the development of adaptive explanation systems tailored to user expertise. These findings support requirements analysis processes by highlighting important factors that should be considered in user-centered methods such as personas.
title How Does Users' App Knowledge Influence the Preferred Level of Detail and Format of Software Explanations?
topic Software Engineering
url https://arxiv.org/abs/2502.06549