Speejis: Enhancing User Experience of Mobile Voice Messaging with Automatic Visual Speech Emotion Cues
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915142880460800 |
|---|---|
| author | Aslan, Ilhan Griggio, Carla F. Pohl, Henning Merritt, Timothy van Berkel, Niels |
| author_facet | Aslan, Ilhan Griggio, Carla F. Pohl, Henning Merritt, Timothy van Berkel, Niels |
| contents | Mobile messaging apps offer an increasing range of emotional expressions, such as emojis to help users manually augment their texting experiences. Accessibility of such augmentations is limited in voice messaging. With the term "speejis" we refer to accessible emojis and other visual speech emotion cues that are created automatically from speech input alone. The paper presents an implementation of speejis and reports on a user study (N=12) comparing the UX of voice messaging with and without speejis. Results show significant differences in measures such as attractiveness and stimulation and a clear preference of all participants for messaging with speejis. We highlight the benefits of using paralinguistic speech processing and continuous emotion models to enable finer grained augmentations of emotion changes and transitions within a single message in addition to augmentations of the overall tone of the message. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_05296 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Speejis: Enhancing User Experience of Mobile Voice Messaging with Automatic Visual Speech Emotion Cues Aslan, Ilhan Griggio, Carla F. Pohl, Henning Merritt, Timothy van Berkel, Niels Human-Computer Interaction Mobile messaging apps offer an increasing range of emotional expressions, such as emojis to help users manually augment their texting experiences. Accessibility of such augmentations is limited in voice messaging. With the term "speejis" we refer to accessible emojis and other visual speech emotion cues that are created automatically from speech input alone. The paper presents an implementation of speejis and reports on a user study (N=12) comparing the UX of voice messaging with and without speejis. Results show significant differences in measures such as attractiveness and stimulation and a clear preference of all participants for messaging with speejis. We highlight the benefits of using paralinguistic speech processing and continuous emotion models to enable finer grained augmentations of emotion changes and transitions within a single message in addition to augmentations of the overall tone of the message. |
| title | Speejis: Enhancing User Experience of Mobile Voice Messaging with Automatic Visual Speech Emotion Cues |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2502.05296 |