Social Conjuring: Multi-User Runtime Collaboration with AI in Building Virtual 3D Worlds

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kobenova, Amina, DeVeaux, Cyan, Parajuli, Samyak, Banburski-Fahey, Andrzej, Fernandez, Judith Amores, Lanier, Jaron
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916420316561408
author Kobenova, Amina
DeVeaux, Cyan
Parajuli, Samyak
Banburski-Fahey, Andrzej
Fernandez, Judith Amores
Lanier, Jaron
author_facet Kobenova, Amina
DeVeaux, Cyan
Parajuli, Samyak
Banburski-Fahey, Andrzej
Fernandez, Judith Amores
Lanier, Jaron
contents Generative artificial intelligence has shown promise in prompting virtual worlds into existence, yet little attention has been given to understanding how this process unfolds as social interaction. We present Social Conjurer, a framework for AI-augmented dynamic 3D scene co-creation, where multiple users collaboratively build and modify virtual worlds in real-time. Through an expanded set of interactions, including social and tool-based engagements as well as spatial reasoning, our framework facilitates the creation of rich, diverse virtual environments. Findings from a preliminary user study (N=12) provide insight into the user experience of this approach, how social contexts shape the prompting of spatial environments, and perspective on social applications of prompt-based 3D co-creation. In addition to highlighting the potential of AI-supported multi-user world creation and offering new pathways for AI-augmented creative processes in VR, this article presents a set of implications for designing human-centered interfaces that incorporate AI models into 3D content generation.
format Preprint
id arxiv_https___arxiv_org_abs_2410_00274
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Social Conjuring: Multi-User Runtime Collaboration with AI in Building Virtual 3D Worlds
Kobenova, Amina
DeVeaux, Cyan
Parajuli, Samyak
Banburski-Fahey, Andrzej
Fernandez, Judith Amores
Lanier, Jaron
Human-Computer Interaction
Artificial Intelligence
Computation and Language
Emerging Technologies
Generative artificial intelligence has shown promise in prompting virtual worlds into existence, yet little attention has been given to understanding how this process unfolds as social interaction. We present Social Conjurer, a framework for AI-augmented dynamic 3D scene co-creation, where multiple users collaboratively build and modify virtual worlds in real-time. Through an expanded set of interactions, including social and tool-based engagements as well as spatial reasoning, our framework facilitates the creation of rich, diverse virtual environments. Findings from a preliminary user study (N=12) provide insight into the user experience of this approach, how social contexts shape the prompting of spatial environments, and perspective on social applications of prompt-based 3D co-creation. In addition to highlighting the potential of AI-supported multi-user world creation and offering new pathways for AI-augmented creative processes in VR, this article presents a set of implications for designing human-centered interfaces that incorporate AI models into 3D content generation.
title Social Conjuring: Multi-User Runtime Collaboration with AI in Building Virtual 3D Worlds
topic Human-Computer Interaction
Artificial Intelligence
Computation and Language
Emerging Technologies
url https://arxiv.org/abs/2410.00274