PlayWrite: A Multimodal System for AI Supported Narrative Co-Authoring Through Play in XR
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908861345038336 |
|---|---|
| author | Tütüncü, Esen K. Zhou, Qian Brudy, Frederik Fitzmaurice, George Anderson, Fraser |
| author_facet | Tütüncü, Esen K. Zhou, Qian Brudy, Frederik Fitzmaurice, George Anderson, Fraser |
| contents | Current AI writing tools, which rely on text prompts, poorly support the spatial and interactive nature of storytelling where ideas emerge from direct manipulation and play. We present PlayWrite, a mixed-reality system where users author stories by directly manipulating virtual characters and props. A multi-agent AI pipeline interprets these actions into Intent Frames -structured narrative beats visualized as rearrangeable story marbles on a timeline. A large language model then transforms the user's assembled sequence into a final narrative. A user study (N=13) with writers from varying domains found that PlayWrite fosters a highly improvisational and playful process. Users treated the AI as a collaborative partner, using its unexpected responses to spark new ideas and overcome creative blocks. PlayWrite demonstrates an approach for co-creative systems that move beyond text to embrace direct manipulation and play as core interaction modalities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_02366 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | PlayWrite: A Multimodal System for AI Supported Narrative Co-Authoring Through Play in XR Tütüncü, Esen K. Zhou, Qian Brudy, Frederik Fitzmaurice, George Anderson, Fraser Human-Computer Interaction Artificial Intelligence Current AI writing tools, which rely on text prompts, poorly support the spatial and interactive nature of storytelling where ideas emerge from direct manipulation and play. We present PlayWrite, a mixed-reality system where users author stories by directly manipulating virtual characters and props. A multi-agent AI pipeline interprets these actions into Intent Frames -structured narrative beats visualized as rearrangeable story marbles on a timeline. A large language model then transforms the user's assembled sequence into a final narrative. A user study (N=13) with writers from varying domains found that PlayWrite fosters a highly improvisational and playful process. Users treated the AI as a collaborative partner, using its unexpected responses to spark new ideas and overcome creative blocks. PlayWrite demonstrates an approach for co-creative systems that move beyond text to embrace direct manipulation and play as core interaction modalities. |
| title | PlayWrite: A Multimodal System for AI Supported Narrative Co-Authoring Through Play in XR |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2603.02366 |