Speaking Without Sound: Multi-speaker Silent Speech Voicing with Facial Inputs Only
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918319094759424 |
|---|---|
| author | Lee, Jaejun Oh, Yoori Lee, Kyogu |
| author_facet | Lee, Jaejun Oh, Yoori Lee, Kyogu |
| contents | In this paper, we introduce a novel framework for generating multi-speaker speech without relying on any audible inputs. Our approach leverages silent electromyography (EMG) signals to capture linguistic content, while facial images are used to match with the vocal identity of the target speaker. Notably, we present a pitch-disentangled content embedding that enhances the extraction of linguistic content from EMG signals. Extensive analysis demonstrates that our method can generate multi-speaker speech without any audible inputs and confirms the effectiveness of the proposed pitch-disentanglement approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_01879 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Speaking Without Sound: Multi-speaker Silent Speech Voicing with Facial Inputs Only Lee, Jaejun Oh, Yoori Lee, Kyogu Sound In this paper, we introduce a novel framework for generating multi-speaker speech without relying on any audible inputs. Our approach leverages silent electromyography (EMG) signals to capture linguistic content, while facial images are used to match with the vocal identity of the target speaker. Notably, we present a pitch-disentangled content embedding that enhances the extraction of linguistic content from EMG signals. Extensive analysis demonstrates that our method can generate multi-speaker speech without any audible inputs and confirms the effectiveness of the proposed pitch-disentanglement approach. |
| title | Speaking Without Sound: Multi-speaker Silent Speech Voicing with Facial Inputs Only |
| topic | Sound |
| url | https://arxiv.org/abs/2602.01879 |