Speech Command + Speech Emotion: Exploring Emotional Speech Commands as a Compound and Playful Modality
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917982574215168 |
|---|---|
| author | Aslan, Ilhan Merritt, Timothy Johansen, Stine S. van Berkel, Niels |
| author_facet | Aslan, Ilhan Merritt, Timothy Johansen, Stine S. van Berkel, Niels |
| contents | In an era of human-computer interaction with increasingly agentic AI systems capable of connecting with users conversationally, speech is an important modality for commanding agents. By recognizing and using speech emotions (i.e., how a command is spoken), we can provide agents with the ability to emotionally accentuate their responses and socially enrich users' perceptions and experiences. To explore the concept and impact of speech emotion commands on user perceptions, we realized a prototype and conducted a user study (N = 14) where speech commands are used to steer two vehicles in a minimalist and retro game style implementation. While both agents execute user commands, only one of the agents uses speech emotion information to adapt its execution behavior. We report on differences in how users perceived each agent, including significant differences in stimulation and dependability, outline implications for designing interactions with agents using emotional speech commands, and provide insights on how users consciously emote, which we describe as "voice acting". |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_08440 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Speech Command + Speech Emotion: Exploring Emotional Speech Commands as a Compound and Playful Modality Aslan, Ilhan Merritt, Timothy Johansen, Stine S. van Berkel, Niels Human-Computer Interaction In an era of human-computer interaction with increasingly agentic AI systems capable of connecting with users conversationally, speech is an important modality for commanding agents. By recognizing and using speech emotions (i.e., how a command is spoken), we can provide agents with the ability to emotionally accentuate their responses and socially enrich users' perceptions and experiences. To explore the concept and impact of speech emotion commands on user perceptions, we realized a prototype and conducted a user study (N = 14) where speech commands are used to steer two vehicles in a minimalist and retro game style implementation. While both agents execute user commands, only one of the agents uses speech emotion information to adapt its execution behavior. We report on differences in how users perceived each agent, including significant differences in stimulation and dependability, outline implications for designing interactions with agents using emotional speech commands, and provide insights on how users consciously emote, which we describe as "voice acting". |
| title | Speech Command + Speech Emotion: Exploring Emotional Speech Commands as a Compound and Playful Modality |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2504.08440 |