Users' Mental Models of Generative AI Chatbot Ecosystems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Xingyi, Wang, Xiaozheng, Park, Sunyup, Yao, Yaxing
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929693172695040
author Wang, Xingyi
Wang, Xiaozheng
Park, Sunyup
Yao, Yaxing
author_facet Wang, Xingyi
Wang, Xiaozheng
Park, Sunyup
Yao, Yaxing
contents The capability of GenAI-based chatbots, such as ChatGPT and Gemini, has expanded quickly in recent years, turning them into GenAI Chatbot Ecosystems. Yet, users' understanding of how such ecosystems work remains unknown. In this paper, we investigate users' mental models of how GenAI Chatbot Ecosystems work. This is an important question because users' mental models guide their behaviors, including making decisions that impact their privacy. Through 21 semi-structured interviews, we uncovered users' four mental models towards first-party (e.g., Google Gemini) and third-party (e.g., ChatGPT) GenAI Chatbot Ecosystems. These mental models centered around the role of the chatbot in the entire ecosystem. We further found that participants held a more consistent and simpler mental model towards third-party ecosystems than the first-party ones, resulting in higher trust and fewer concerns towards the third-party ecosystems. We discuss the design and policy implications based on our results.
format Preprint
id arxiv_https___arxiv_org_abs_2501_19211
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Users' Mental Models of Generative AI Chatbot Ecosystems
Wang, Xingyi
Wang, Xiaozheng
Park, Sunyup
Yao, Yaxing
Human-Computer Interaction
The capability of GenAI-based chatbots, such as ChatGPT and Gemini, has expanded quickly in recent years, turning them into GenAI Chatbot Ecosystems. Yet, users' understanding of how such ecosystems work remains unknown. In this paper, we investigate users' mental models of how GenAI Chatbot Ecosystems work. This is an important question because users' mental models guide their behaviors, including making decisions that impact their privacy. Through 21 semi-structured interviews, we uncovered users' four mental models towards first-party (e.g., Google Gemini) and third-party (e.g., ChatGPT) GenAI Chatbot Ecosystems. These mental models centered around the role of the chatbot in the entire ecosystem. We further found that participants held a more consistent and simpler mental model towards third-party ecosystems than the first-party ones, resulting in higher trust and fewer concerns towards the third-party ecosystems. We discuss the design and policy implications based on our results.
title Users' Mental Models of Generative AI Chatbot Ecosystems
topic Human-Computer Interaction
url https://arxiv.org/abs/2501.19211