Multi-Level Attention Aggregation for Language-Agnostic Speaker Replication
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909158978093056 |
|---|---|
| author | Jeon, Yejin Lee, Gary Geunbae |
| author_facet | Jeon, Yejin Lee, Gary Geunbae |
| contents | This paper explores the task of language-agnostic speaker replication, a novel endeavor that seeks to replicate a speaker's voice irrespective of the language they are speaking. Towards this end, we introduce a multi-level attention aggregation approach that systematically probes and amplifies various speaker-specific attributes in a hierarchical manner. Through rigorous evaluations across a wide range of scenarios including seen and unseen speakers conversing in seen and unseen lingua, we establish that our proposed model is able to achieve substantial speaker similarity, and is able to generalize to out-of-domain (OOD) cases. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_04111 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Multi-Level Attention Aggregation for Language-Agnostic Speaker Replication Jeon, Yejin Lee, Gary Geunbae Sound Audio and Speech Processing This paper explores the task of language-agnostic speaker replication, a novel endeavor that seeks to replicate a speaker's voice irrespective of the language they are speaking. Towards this end, we introduce a multi-level attention aggregation approach that systematically probes and amplifies various speaker-specific attributes in a hierarchical manner. Through rigorous evaluations across a wide range of scenarios including seen and unseen speakers conversing in seen and unseen lingua, we establish that our proposed model is able to achieve substantial speaker similarity, and is able to generalize to out-of-domain (OOD) cases. |
| title | Multi-Level Attention Aggregation for Language-Agnostic Speaker Replication |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2403.04111 |