Understanding Mental Models of Generative Conversational Search and The Effect of Interface Transparency
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909636777476096 |
|---|---|
| author | Degachi, Chadha Freire, Samuel Kernan Niforatos, Evangelos Kortuem, Gerd |
| author_facet | Degachi, Chadha Freire, Samuel Kernan Niforatos, Evangelos Kortuem, Gerd |
| contents | The experience and adoption of conversational search is tied to the accuracy and completeness of users' mental models -- their internal frameworks for understanding and predicting system behaviour. Thus, understanding these models can reveal areas for design interventions. Transparency is one such intervention which can improve system interpretability and enable mental model alignment. While past research has explored mental models of search engines, those of generative conversational search remain underexplored, even while the popularity of these systems soars. To address this, we conducted a study with 16 participants, who performed 4 search tasks using 4 conversational interfaces of varying transparency levels. Our analysis revealed that most user mental models were too abstract to support users in explaining individual search instances. These results suggest that 1) mental models may pose a barrier to appropriate trust in conversational search, and 2) hybrid web-conversational search is a promising novel direction for future search interface design. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_03807 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Understanding Mental Models of Generative Conversational Search and The Effect of Interface Transparency Degachi, Chadha Freire, Samuel Kernan Niforatos, Evangelos Kortuem, Gerd Human-Computer Interaction Information Retrieval The experience and adoption of conversational search is tied to the accuracy and completeness of users' mental models -- their internal frameworks for understanding and predicting system behaviour. Thus, understanding these models can reveal areas for design interventions. Transparency is one such intervention which can improve system interpretability and enable mental model alignment. While past research has explored mental models of search engines, those of generative conversational search remain underexplored, even while the popularity of these systems soars. To address this, we conducted a study with 16 participants, who performed 4 search tasks using 4 conversational interfaces of varying transparency levels. Our analysis revealed that most user mental models were too abstract to support users in explaining individual search instances. These results suggest that 1) mental models may pose a barrier to appropriate trust in conversational search, and 2) hybrid web-conversational search is a promising novel direction for future search interface design. |
| title | Understanding Mental Models of Generative Conversational Search and The Effect of Interface Transparency |
| topic | Human-Computer Interaction Information Retrieval |
| url | https://arxiv.org/abs/2506.03807 |