Proactive Detection of Voice Cloning with Localized Watermarking
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914826343677952 |
|---|---|
| author | Roman, Robin San Fernandez, Pierre Défossez, Alexandre Furon, Teddy Tran, Tuan Elsahar, Hady |
| author_facet | Roman, Robin San Fernandez, Pierre Défossez, Alexandre Furon, Teddy Tran, Tuan Elsahar, Hady |
| contents | In the rapidly evolving field of speech generative models, there is a pressing need to ensure audio authenticity against the risks of voice cloning. We present AudioSeal, the first audio watermarking technique designed specifically for localized detection of AI-generated speech. AudioSeal employs a generator/detector architecture trained jointly with a localization loss to enable localized watermark detection up to the sample level, and a novel perceptual loss inspired by auditory masking, that enables AudioSeal to achieve better imperceptibility. AudioSeal achieves state-of-the-art performance in terms of robustness to real life audio manipulations and imperceptibility based on automatic and human evaluation metrics. Additionally, AudioSeal is designed with a fast, single-pass detector, that significantly surpasses existing models in speed - achieving detection up to two orders of magnitude faster, making it ideal for large-scale and real-time applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_17264 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Proactive Detection of Voice Cloning with Localized Watermarking Roman, Robin San Fernandez, Pierre Défossez, Alexandre Furon, Teddy Tran, Tuan Elsahar, Hady Sound Artificial Intelligence Cryptography and Security In the rapidly evolving field of speech generative models, there is a pressing need to ensure audio authenticity against the risks of voice cloning. We present AudioSeal, the first audio watermarking technique designed specifically for localized detection of AI-generated speech. AudioSeal employs a generator/detector architecture trained jointly with a localization loss to enable localized watermark detection up to the sample level, and a novel perceptual loss inspired by auditory masking, that enables AudioSeal to achieve better imperceptibility. AudioSeal achieves state-of-the-art performance in terms of robustness to real life audio manipulations and imperceptibility based on automatic and human evaluation metrics. Additionally, AudioSeal is designed with a fast, single-pass detector, that significantly surpasses existing models in speed - achieving detection up to two orders of magnitude faster, making it ideal for large-scale and real-time applications. |
| title | Proactive Detection of Voice Cloning with Localized Watermarking |
| topic | Sound Artificial Intelligence Cryptography and Security |
| url | https://arxiv.org/abs/2401.17264 |