AVIN-Chat: An Audio-Visual Interactive Chatbot System with Emotional State Tuning

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Park, Chanhyuk, Cho, Jungbin, Kim, Junwan, Lee, Seongmin, Kim, Jungsu, Lee, Sanghoon
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917765271519232
author Park, Chanhyuk
Cho, Jungbin
Kim, Junwan
Lee, Seongmin
Kim, Jungsu
Lee, Sanghoon
author_facet Park, Chanhyuk
Cho, Jungbin
Kim, Junwan
Lee, Seongmin
Kim, Jungsu
Lee, Sanghoon
contents This work presents an audio-visual interactive chatbot (AVIN-Chat) system that allows users to have face-to-face conversations with 3D avatars in real-time. Compared to the previous chatbot services, which provide text-only or speech-only communications, the proposed AVIN-Chat can offer audio-visual communications providing users with a superior experience quality. In addition, the proposed AVIN-Chat emotionally speaks and expresses according to the user's emotional state. Thus, it enables users to establish a strong bond with the chatbot system, increasing the user's immersion. Through user subjective tests, it is demonstrated that the proposed system provides users with a higher sense of immersion than previous chatbot systems. The demonstration video is available at https://www.youtube.com/watch?v=Z74uIV9k7_k.
format Preprint
id arxiv_https___arxiv_org_abs_2409_00012
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AVIN-Chat: An Audio-Visual Interactive Chatbot System with Emotional State Tuning
Park, Chanhyuk
Cho, Jungbin
Kim, Junwan
Lee, Seongmin
Kim, Jungsu
Lee, Sanghoon
Human-Computer Interaction
Artificial Intelligence
This work presents an audio-visual interactive chatbot (AVIN-Chat) system that allows users to have face-to-face conversations with 3D avatars in real-time. Compared to the previous chatbot services, which provide text-only or speech-only communications, the proposed AVIN-Chat can offer audio-visual communications providing users with a superior experience quality. In addition, the proposed AVIN-Chat emotionally speaks and expresses according to the user's emotional state. Thus, it enables users to establish a strong bond with the chatbot system, increasing the user's immersion. Through user subjective tests, it is demonstrated that the proposed system provides users with a higher sense of immersion than previous chatbot systems. The demonstration video is available at https://www.youtube.com/watch?v=Z74uIV9k7_k.
title AVIN-Chat: An Audio-Visual Interactive Chatbot System with Emotional State Tuning
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2409.00012