Leveraging WaveNet for Dynamic Listening Head Modeling from Speech
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912018841206784 |
|---|---|
| author | Nguyen, Minh-Duc Yang, Hyung-Jeong Kim, Seung-Won Shin, Ji-Eun Kim, Soo-Hyung |
| author_facet | Nguyen, Minh-Duc Yang, Hyung-Jeong Kim, Seung-Won Shin, Ji-Eun Kim, Soo-Hyung |
| contents | The creation of listener facial responses aims to simulate interactive communication feedback from a listener during a face-to-face conversation. Our goal is to generate believable videos of listeners' heads that respond authentically to a single speaker by a sequence-to-sequence model with an combination of WaveNet and Long short-term memory network. Our approach focuses on capturing the subtle nuances of listener feedback, ensuring the preservation of individual listener identity while expressing appropriate attitudes and viewpoints. Experiment results show that our method surpasses the baseline models on ViCo benchmark Dataset. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_05089 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Leveraging WaveNet for Dynamic Listening Head Modeling from Speech Nguyen, Minh-Duc Yang, Hyung-Jeong Kim, Seung-Won Shin, Ji-Eun Kim, Soo-Hyung Computer Vision and Pattern Recognition The creation of listener facial responses aims to simulate interactive communication feedback from a listener during a face-to-face conversation. Our goal is to generate believable videos of listeners' heads that respond authentically to a single speaker by a sequence-to-sequence model with an combination of WaveNet and Long short-term memory network. Our approach focuses on capturing the subtle nuances of listener feedback, ensuring the preservation of individual listener identity while expressing appropriate attitudes and viewpoints. Experiment results show that our method surpasses the baseline models on ViCo benchmark Dataset. |
| title | Leveraging WaveNet for Dynamic Listening Head Modeling from Speech |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.05089 |