Metamorpheus: Interactive, Affective, and Creative Dream Narration Through Metaphorical Visual Storytelling

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wan, Qian, Feng, Xin, Bei, Yining, Gao, Zhiqi, Lu, Zhicong
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913254262964224
author Wan, Qian
Feng, Xin
Bei, Yining
Gao, Zhiqi
Lu, Zhicong
author_facet Wan, Qian
Feng, Xin
Bei, Yining
Gao, Zhiqi
Lu, Zhicong
contents Human emotions are essentially molded by lived experiences, from which we construct personalised meaning. The engagement in such meaning-making process has been practiced as an intervention in various psychotherapies to promote wellness. Nevertheless, to support recollecting and recounting lived experiences in everyday life remains under explored in HCI. It also remains unknown how technologies such as generative AI models can facilitate the meaning making process, and ultimately support affective mindfulness. In this paper we present Metamorpheus, an affective interface that engages users in a creative visual storytelling of emotional experiences during dreams. Metamorpheus arranges the storyline based on a dream's emotional arc, and provokes self-reflection through the creation of metaphorical images and text depictions. The system provides metaphor suggestions, and generates visual metaphors and text depictions using generative AI models, while users can apply generations to recolour and re-arrange the interface to be visually affective. Our experience-centred evaluation manifests that, by interacting with Metamorpheus, users can recall their dreams in vivid detail, through which they relive and reflect upon their experiences in a meaningful way.
format Preprint
id arxiv_https___arxiv_org_abs_2403_00632
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Metamorpheus: Interactive, Affective, and Creative Dream Narration Through Metaphorical Visual Storytelling
Wan, Qian
Feng, Xin
Bei, Yining
Gao, Zhiqi
Lu, Zhicong
Human-Computer Interaction
Artificial Intelligence
Computation and Language
Computers and Society
Human emotions are essentially molded by lived experiences, from which we construct personalised meaning. The engagement in such meaning-making process has been practiced as an intervention in various psychotherapies to promote wellness. Nevertheless, to support recollecting and recounting lived experiences in everyday life remains under explored in HCI. It also remains unknown how technologies such as generative AI models can facilitate the meaning making process, and ultimately support affective mindfulness. In this paper we present Metamorpheus, an affective interface that engages users in a creative visual storytelling of emotional experiences during dreams. Metamorpheus arranges the storyline based on a dream's emotional arc, and provokes self-reflection through the creation of metaphorical images and text depictions. The system provides metaphor suggestions, and generates visual metaphors and text depictions using generative AI models, while users can apply generations to recolour and re-arrange the interface to be visually affective. Our experience-centred evaluation manifests that, by interacting with Metamorpheus, users can recall their dreams in vivid detail, through which they relive and reflect upon their experiences in a meaningful way.
title Metamorpheus: Interactive, Affective, and Creative Dream Narration Through Metaphorical Visual Storytelling
topic Human-Computer Interaction
Artificial Intelligence
Computation and Language
Computers and Society
url https://arxiv.org/abs/2403.00632