DrawTalking: Building Interactive Worlds by Sketching and Speaking

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Rosenberg, Karl Toby, Kazi, Rubaiat Habib, Wei, Li-Yi, Xia, Haijun, Perlin, Ken
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913459086557184
author Rosenberg, Karl Toby
Kazi, Rubaiat Habib
Wei, Li-Yi
Xia, Haijun
Perlin, Ken
author_facet Rosenberg, Karl Toby
Kazi, Rubaiat Habib
Wei, Li-Yi
Xia, Haijun
Perlin, Ken
contents We introduce DrawTalking, an approach to building and controlling interactive worlds by sketching and speaking while telling stories. It emphasizes user control and flexibility, and gives programming-like capability without requiring code. An early open-ended study with our prototype shows that the mechanics resonate and are applicable to many creative-exploratory use cases, with the potential to inspire and inform research in future natural interfaces for creative exploration and authoring.
format Preprint
id arxiv_https___arxiv_org_abs_2401_05631
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DrawTalking: Building Interactive Worlds by Sketching and Speaking
Rosenberg, Karl Toby
Kazi, Rubaiat Habib
Wei, Li-Yi
Xia, Haijun
Perlin, Ken
Human-Computer Interaction
Artificial Intelligence
Computation and Language
Emerging Technologies
Graphics
H.5.2; D.2.2; I.2.7; D.1.7; H.5.1
We introduce DrawTalking, an approach to building and controlling interactive worlds by sketching and speaking while telling stories. It emphasizes user control and flexibility, and gives programming-like capability without requiring code. An early open-ended study with our prototype shows that the mechanics resonate and are applicable to many creative-exploratory use cases, with the potential to inspire and inform research in future natural interfaces for creative exploration and authoring.
title DrawTalking: Building Interactive Worlds by Sketching and Speaking
topic Human-Computer Interaction
Artificial Intelligence
Computation and Language
Emerging Technologies
Graphics
H.5.2; D.2.2; I.2.7; D.1.7; H.5.1
url https://arxiv.org/abs/2401.05631