CreepyCoCreator? Investigating AI Representation Modes for 3D Object Co-Creation in Virtual Reality

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Rasch, Julian, Töws, Julia, Hirzle, Teresa, Müller, Florian, Schmitz, Martin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913701042323456
author Rasch, Julian
Töws, Julia
Hirzle, Teresa
Müller, Florian
Schmitz, Martin
author_facet Rasch, Julian
Töws, Julia
Hirzle, Teresa
Müller, Florian
Schmitz, Martin
contents Generative AI in Virtual Reality offers the potential for collaborative object-building, yet challenges remain in aligning AI contributions with user expectations. In particular, users often struggle to understand and collaborate with AI when its actions are not transparently represented. This paper thus explores the co-creative object-building process through a Wizard-of-Oz study, focusing on how AI can effectively convey its intent to users during object customization in Virtual Reality. Inspired by human-to-human collaboration, we focus on three representation modes: the presence of an embodied avatar, whether the AI's contributions are visualized immediately or incrementally, and whether the areas modified are highlighted in advance. The findings provide insights into how these factors affect user perception and interaction with object-generating AI tools in Virtual Reality as well as satisfaction and ownership of the created objects. The results offer design implications for co-creative world-building systems, aiming to foster more effective and satisfying collaborations between humans and AI in Virtual Reality.
format Preprint
id arxiv_https___arxiv_org_abs_2502_03069
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CreepyCoCreator? Investigating AI Representation Modes for 3D Object Co-Creation in Virtual Reality
Rasch, Julian
Töws, Julia
Hirzle, Teresa
Müller, Florian
Schmitz, Martin
Human-Computer Interaction
Generative AI in Virtual Reality offers the potential for collaborative object-building, yet challenges remain in aligning AI contributions with user expectations. In particular, users often struggle to understand and collaborate with AI when its actions are not transparently represented. This paper thus explores the co-creative object-building process through a Wizard-of-Oz study, focusing on how AI can effectively convey its intent to users during object customization in Virtual Reality. Inspired by human-to-human collaboration, we focus on three representation modes: the presence of an embodied avatar, whether the AI's contributions are visualized immediately or incrementally, and whether the areas modified are highlighted in advance. The findings provide insights into how these factors affect user perception and interaction with object-generating AI tools in Virtual Reality as well as satisfaction and ownership of the created objects. The results offer design implications for co-creative world-building systems, aiming to foster more effective and satisfying collaborations between humans and AI in Virtual Reality.
title CreepyCoCreator? Investigating AI Representation Modes for 3D Object Co-Creation in Virtual Reality
topic Human-Computer Interaction
url https://arxiv.org/abs/2502.03069