AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencoder
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929668296278016 |
|---|---|
| author | Sadok, Samir Leglaive, Simon Girin, Laurent Richard, Gaël Alameda-Pineda, Xavier |
| author_facet | Sadok, Samir Leglaive, Simon Girin, Laurent Richard, Gaël Alameda-Pineda, Xavier |
| contents | This article introduces AnCoGen, a novel method that leverages a masked autoencoder to unify the analysis, control, and generation of speech signals within a single model. AnCoGen can analyze speech by estimating key attributes, such as speaker identity, pitch, content, loudness, signal-to-noise ratio, and clarity index. In addition, it can generate speech from these attributes and allow precise control of the synthesized speech by modifying them. Extensive experiments demonstrated the effectiveness of AnCoGen across speech analysis-resynthesis, pitch estimation, pitch modification, and speech enhancement. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_05332 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencoder Sadok, Samir Leglaive, Simon Girin, Laurent Richard, Gaël Alameda-Pineda, Xavier Sound Artificial Intelligence Audio and Speech Processing This article introduces AnCoGen, a novel method that leverages a masked autoencoder to unify the analysis, control, and generation of speech signals within a single model. AnCoGen can analyze speech by estimating key attributes, such as speaker identity, pitch, content, loudness, signal-to-noise ratio, and clarity index. In addition, it can generate speech from these attributes and allow precise control of the synthesized speech by modifying them. Extensive experiments demonstrated the effectiveness of AnCoGen across speech analysis-resynthesis, pitch estimation, pitch modification, and speech enhancement. |
| title | AnCoGen: Analysis, Control and Generation of Speech with a Masked Autoencoder |
| topic | Sound Artificial Intelligence Audio and Speech Processing |
| url | https://arxiv.org/abs/2501.05332 |