Toward a Unified Metadata Schema for Ecological Momentary Assessment with Voice-First Virtual Assistants

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Chen, Mrini, Khalil, Charles, Kemeberly, Lifset, Ella T., Hogarth, Michael, Moore, Alison A., Weibel, Nadir, Farcas, Emilia
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913420328042496
author Chen, Chen
Mrini, Khalil
Charles, Kemeberly
Lifset, Ella T.
Hogarth, Michael
Moore, Alison A.
Weibel, Nadir
Farcas, Emilia
author_facet Chen, Chen
Mrini, Khalil
Charles, Kemeberly
Lifset, Ella T.
Hogarth, Michael
Moore, Alison A.
Weibel, Nadir
Farcas, Emilia
contents Ecological momentary assessment (EMA) is used to evaluate subjects' behaviors and moods in their natural environments, yet collecting real-time and self-report data with EMA is challenging due to user burden. Integrating voice into EMA data collection platforms through today's intelligent virtual assistants (IVAs) is promising due to hands-free and eye-free nature. However, efficiently managing conversations and EMAs is non-trivial and time consuming due to the ambiguity of the voice input. We approach this problem by rethinking the data modeling of EMA questions and what is needed to deploy them on voice-first user interfaces. We propose a unified metadata schema that models EMA questions and the necessary attributes to effectively and efficiently integrate voice as a new EMA modality. Our schema allows user experience researchers to write simple rules that can be rendered at run-time, instead of having to edit the source code. We showcase an example EMA survey implemented with our schema, which can run on multiple voice-only and voice-first devices. We believe that our work will accelerate the iterative prototyping and design process of real-world voice-based EMA data collection platforms.
format Preprint
id arxiv_https___arxiv_org_abs_2407_05203
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Toward a Unified Metadata Schema for Ecological Momentary Assessment with Voice-First Virtual Assistants
Chen, Chen
Mrini, Khalil
Charles, Kemeberly
Lifset, Ella T.
Hogarth, Michael
Moore, Alison A.
Weibel, Nadir
Farcas, Emilia
Human-Computer Interaction
K.4.m; J.3; H.4
Ecological momentary assessment (EMA) is used to evaluate subjects' behaviors and moods in their natural environments, yet collecting real-time and self-report data with EMA is challenging due to user burden. Integrating voice into EMA data collection platforms through today's intelligent virtual assistants (IVAs) is promising due to hands-free and eye-free nature. However, efficiently managing conversations and EMAs is non-trivial and time consuming due to the ambiguity of the voice input. We approach this problem by rethinking the data modeling of EMA questions and what is needed to deploy them on voice-first user interfaces. We propose a unified metadata schema that models EMA questions and the necessary attributes to effectively and efficiently integrate voice as a new EMA modality. Our schema allows user experience researchers to write simple rules that can be rendered at run-time, instead of having to edit the source code. We showcase an example EMA survey implemented with our schema, which can run on multiple voice-only and voice-first devices. We believe that our work will accelerate the iterative prototyping and design process of real-world voice-based EMA data collection platforms.
title Toward a Unified Metadata Schema for Ecological Momentary Assessment with Voice-First Virtual Assistants
topic Human-Computer Interaction
K.4.m; J.3; H.4
url https://arxiv.org/abs/2407.05203