Analysis and Detection of Differences in Spoken User Behaviors between Autonomous and Wizard-of-Oz Systems
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914964284899328 |
|---|---|
| author | Elmers, Mikey Inoue, Koji Lala, Divesh Ochi, Keiko Kawahara, Tatsuya |
| author_facet | Elmers, Mikey Inoue, Koji Lala, Divesh Ochi, Keiko Kawahara, Tatsuya |
| contents | This study examined users' behavioral differences in a large corpus of Japanese human-robot interactions, comparing interactions between a tele-operated robot and an autonomous dialogue system. We analyzed user spoken behaviors in both attentive listening and job interview dialogue scenarios. Results revealed significant differences in metrics such as speech length, speaking rate, fillers, backchannels, disfluencies, and laughter between operator-controlled and autonomous conditions. Furthermore, we developed predictive models to distinguish between operator and autonomous system conditions. Our models demonstrated higher accuracy and precision compared to the baseline model, with several models also achieving a higher F1 score than the baseline. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_03147 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Analysis and Detection of Differences in Spoken User Behaviors between Autonomous and Wizard-of-Oz Systems Elmers, Mikey Inoue, Koji Lala, Divesh Ochi, Keiko Kawahara, Tatsuya Computation and Language Human-Computer Interaction Robotics This study examined users' behavioral differences in a large corpus of Japanese human-robot interactions, comparing interactions between a tele-operated robot and an autonomous dialogue system. We analyzed user spoken behaviors in both attentive listening and job interview dialogue scenarios. Results revealed significant differences in metrics such as speech length, speaking rate, fillers, backchannels, disfluencies, and laughter between operator-controlled and autonomous conditions. Furthermore, we developed predictive models to distinguish between operator and autonomous system conditions. Our models demonstrated higher accuracy and precision compared to the baseline model, with several models also achieving a higher F1 score than the baseline. |
| title | Analysis and Detection of Differences in Spoken User Behaviors between Autonomous and Wizard-of-Oz Systems |
| topic | Computation and Language Human-Computer Interaction Robotics |
| url | https://arxiv.org/abs/2410.03147 |