Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913461697511424 |
|---|---|
| author | Deichler, Anna Alexanderson, Simon Beskow, Jonas |
| author_facet | Deichler, Anna Alexanderson, Simon Beskow, Jonas |
| contents | This paper focuses on enhancing human-agent communication by integrating spatial context into virtual agents' non-verbal behaviors, specifically gestures. Recent advances in co-speech gesture generation have primarily utilized data-driven methods, which create natural motion but limit the scope of gestures to those performed in a void. Our work aims to extend these methods by enabling generative models to incorporate scene information into speech-driven gesture synthesis. We introduce a novel synthetic gesture dataset tailored for this purpose. This development represents a critical step toward creating embodied conversational agents that interact more naturally with their environment and users. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_04127 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents Deichler, Anna Alexanderson, Simon Beskow, Jonas Human-Computer Interaction Computation and Language Graphics I.3.6; I.2.10 This paper focuses on enhancing human-agent communication by integrating spatial context into virtual agents' non-verbal behaviors, specifically gestures. Recent advances in co-speech gesture generation have primarily utilized data-driven methods, which create natural motion but limit the scope of gestures to those performed in a void. Our work aims to extend these methods by enabling generative models to incorporate scene information into speech-driven gesture synthesis. We introduce a novel synthetic gesture dataset tailored for this purpose. This development represents a critical step toward creating embodied conversational agents that interact more naturally with their environment and users. |
| title | Incorporating Spatial Awareness in Data-Driven Gesture Generation for Virtual Agents |
| topic | Human-Computer Interaction Computation and Language Graphics I.3.6; I.2.10 |
| url | https://arxiv.org/abs/2408.04127 |