Neural Speech Embeddings for Speech Synthesis Based on Deep Generative Networks
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916140223037440 |
|---|---|
| author | Lee, Seo-Hyun Lee, Young-Eun Kim, Soowon Ko, Byung-Kwan Kim, Jun-Young Lee, Seong-Whan |
| author_facet | Lee, Seo-Hyun Lee, Young-Eun Kim, Soowon Ko, Byung-Kwan Kim, Jun-Young Lee, Seong-Whan |
| contents | Brain-to-speech technology represents a fusion of interdisciplinary applications encompassing fields of artificial intelligence, brain-computer interfaces, and speech synthesis. Neural representation learning based intention decoding and speech synthesis directly connects the neural activity to the means of human linguistic communication, which may greatly enhance the naturalness of communication. With the current discoveries on representation learning and the development of the speech synthesis technologies, direct translation of brain signals into speech has shown great promise. Especially, the processed input features and neural speech embeddings which are given to the neural network play a significant role in the overall performance when using deep generative models for speech generation from brain signals. In this paper, we introduce the current brain-to-speech technology with the possibility of speech synthesis from brain signals, which may ultimately facilitate innovation in non-verbal communication. Also, we perform comprehensive analysis on the neural features and neural speech embeddings underlying the neurophysiological activation while performing speech, which may play a significant role in the speech synthesis works. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_05814 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Neural Speech Embeddings for Speech Synthesis Based on Deep Generative Networks Lee, Seo-Hyun Lee, Young-Eun Kim, Soowon Ko, Byung-Kwan Kim, Jun-Young Lee, Seong-Whan Artificial Intelligence Sound Audio and Speech Processing Brain-to-speech technology represents a fusion of interdisciplinary applications encompassing fields of artificial intelligence, brain-computer interfaces, and speech synthesis. Neural representation learning based intention decoding and speech synthesis directly connects the neural activity to the means of human linguistic communication, which may greatly enhance the naturalness of communication. With the current discoveries on representation learning and the development of the speech synthesis technologies, direct translation of brain signals into speech has shown great promise. Especially, the processed input features and neural speech embeddings which are given to the neural network play a significant role in the overall performance when using deep generative models for speech generation from brain signals. In this paper, we introduce the current brain-to-speech technology with the possibility of speech synthesis from brain signals, which may ultimately facilitate innovation in non-verbal communication. Also, we perform comprehensive analysis on the neural features and neural speech embeddings underlying the neurophysiological activation while performing speech, which may play a significant role in the speech synthesis works. |
| title | Neural Speech Embeddings for Speech Synthesis Based on Deep Generative Networks |
| topic | Artificial Intelligence Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2312.05814 |