RLSpoofer: A Lightweight Evaluator for LLM Watermark Spoofing Resilience

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Huang, Hanbo, Gong, Xuan, Zhang, Yiran, Zheng, Hao, Liang, Shiyu
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918443178000384
author Huang, Hanbo
Gong, Xuan
Zhang, Yiran
Zheng, Hao
Liang, Shiyu
author_facet Huang, Hanbo
Gong, Xuan
Zhang, Yiran
Zheng, Hao
Liang, Shiyu
contents Large language model (LLM) watermarking has emerged as a promising approach for detecting and attributing AI-generated text, yet its robustness to black-box spoofing remains insufficiently evaluated. Existing evaluation methods often demand extensive datasets and white-box access to algorithmic internals, limiting their practical applicability. In this paper, we study watermark resilience against spoofing fundamentally from a distributional perspective. We first establish a \textit{local capacity bottleneck}, which theoretically characterizes the probability mass that can be reallocated under KL-bounded local updates while preserving semantic fidelity. Building on this, we propose RLSpoofer, a reinforcement learning-based black-box spoofing attack that requires only 100 human-watermarked paraphrase training pairs and zero access to the watermarking internals or detectors. Despite weak supervision, it empowers a 4B model to achieve a 62.0\% spoof success rate with minimal semantic shift on PF-marked texts, dwarfing the 6\% of baseline models trained on up to 10,000 samples. Our findings expose the fragile spoofing resistance of current LLM watermarking paradigms, providing a lightweight evaluation framework and stressing the urgent need for more robust schemes.
format Preprint
id arxiv_https___arxiv_org_abs_2604_11546
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle RLSpoofer: A Lightweight Evaluator for LLM Watermark Spoofing Resilience
Huang, Hanbo
Gong, Xuan
Zhang, Yiran
Zheng, Hao
Liang, Shiyu
Cryptography and Security
Large language model (LLM) watermarking has emerged as a promising approach for detecting and attributing AI-generated text, yet its robustness to black-box spoofing remains insufficiently evaluated. Existing evaluation methods often demand extensive datasets and white-box access to algorithmic internals, limiting their practical applicability. In this paper, we study watermark resilience against spoofing fundamentally from a distributional perspective. We first establish a \textit{local capacity bottleneck}, which theoretically characterizes the probability mass that can be reallocated under KL-bounded local updates while preserving semantic fidelity. Building on this, we propose RLSpoofer, a reinforcement learning-based black-box spoofing attack that requires only 100 human-watermarked paraphrase training pairs and zero access to the watermarking internals or detectors. Despite weak supervision, it empowers a 4B model to achieve a 62.0\% spoof success rate with minimal semantic shift on PF-marked texts, dwarfing the 6\% of baseline models trained on up to 10,000 samples. Our findings expose the fragile spoofing resistance of current LLM watermarking paradigms, providing a lightweight evaluation framework and stressing the urgent need for more robust schemes.
title RLSpoofer: A Lightweight Evaluator for LLM Watermark Spoofing Resilience
topic Cryptography and Security
url https://arxiv.org/abs/2604.11546