Saved in:
Bibliographic Details
Main Authors: Wu, Yihan, Milis, Georgios, Chen, Ruibo, Huang, Heng
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.21115
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912668413067264
author Wu, Yihan
Milis, Georgios
Chen, Ruibo
Huang, Heng
author_facet Wu, Yihan
Milis, Georgios
Chen, Ruibo
Huang, Heng
contents The rapid advancement of next-token-prediction models has led to widespread adoption across modalities, enabling the creation of realistic synthetic media. In the audio domain, while autoregressive speech models have propelled conversational interactions forward, the potential for misuse, such as impersonation in phishing schemes or crafting misleading speech recordings, has also increased. Security measures such as watermarking have thus become essential to ensuring the authenticity of digital media. Traditional statistical watermarking methods used for autoregressive language models face challenges when applied to autoregressive audio models, due to the inevitable ``retokenization mismatch'' - the discrepancy between original and retokenized discrete audio token sequences. To address this, we introduce Aligned-IS, a novel, distortion-free watermark, specifically crafted for audio generation models. This technique utilizes a clustering approach that treats tokens within the same cluster equivalently, effectively countering the retokenization mismatch issue. Our comprehensive testing on prevalent audio generation platforms demonstrates that Aligned-IS not only preserves the quality of generated audio but also significantly improves the watermark detectability compared to the state-of-the-art distortion-free watermarking adaptations, establishing a new benchmark in secure audio technology applications.
format Preprint
id arxiv_https___arxiv_org_abs_2510_21115
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robust Distortion-Free Watermark for Autoregressive Audio Generation Models
Wu, Yihan
Milis, Georgios
Chen, Ruibo
Huang, Heng
Sound
The rapid advancement of next-token-prediction models has led to widespread adoption across modalities, enabling the creation of realistic synthetic media. In the audio domain, while autoregressive speech models have propelled conversational interactions forward, the potential for misuse, such as impersonation in phishing schemes or crafting misleading speech recordings, has also increased. Security measures such as watermarking have thus become essential to ensuring the authenticity of digital media. Traditional statistical watermarking methods used for autoregressive language models face challenges when applied to autoregressive audio models, due to the inevitable ``retokenization mismatch'' - the discrepancy between original and retokenized discrete audio token sequences. To address this, we introduce Aligned-IS, a novel, distortion-free watermark, specifically crafted for audio generation models. This technique utilizes a clustering approach that treats tokens within the same cluster equivalently, effectively countering the retokenization mismatch issue. Our comprehensive testing on prevalent audio generation platforms demonstrates that Aligned-IS not only preserves the quality of generated audio but also significantly improves the watermark detectability compared to the state-of-the-art distortion-free watermarking adaptations, establishing a new benchmark in secure audio technology applications.
title Robust Distortion-Free Watermark for Autoregressive Audio Generation Models
topic Sound
url https://arxiv.org/abs/2510.21115