Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Yaopeng, Wang, Qingliang, Wang, Zhibo, Xu, Huiyu, Du, Jiacheng, Wang, Qiu, Yin, Jia-Li, Ren, Kui
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:https://arxiv.org/abs/2605.29569
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913169884053504
author Wang, Yaopeng
Wang, Qingliang
Wang, Zhibo
Xu, Huiyu
Du, Jiacheng
Wang, Qiu
Yin, Jia-Li
Ren, Kui
author_facet Wang, Yaopeng
Wang, Qingliang
Wang, Zhibo
Xu, Huiyu
Du, Jiacheng
Wang, Qiu
Yin, Jia-Li
Ren, Kui
contents Low-Rank Adaptation (LoRA) has become a widely used mechanism for customizing text-to-image diffusion models, enabling lightweight modules that are shared, reused, and commercialized as independent assets. This LoRA-centric ecosystem shifts copyright protection from foundation models to distributed LoRA modules, which are easy to copy, redistribute, or reuse without authorization. Existing watermarking methods either protect the base diffusion model or require watermark-aware retraining for each target LoRA, limiting their practicality in open community settings. To address this limitation, we propose LoRA-Key, a user-centric LoRA watermarking framework that treats copyright protection as a reusable ownership key. LoRA-Key encapsulates a recoverable secret message into a standalone user-specific Watermark LoRA, which can be attached to different target LoRAs through training-free linear superposition without per-LoRA retraining or structural modification. To train such a reusable key, we first establish a latent watermark prior in the frozen VAE latent space for robust message embedding and recovery, and then optimize the Watermark LoRA with message-conditioned watermark supervision and semantic consistency constraints. We further introduce Gradient Orthogonal Projection (GOP) to suppress watermark updates that conflict with semantic-preserving directions, reducing interference with generation fidelity and downstream style adaptation. Extensive experiments show that LoRA-Key provides lightweight plug-and-play copyright protection while preserving generation quality and style fidelity, and maintains robust ownership verification under image-level distortions, downstream fine-tuning, and multi-LoRA composition.
format Preprint
id arxiv_https___arxiv_org_abs_2605_29569
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LoRA-Key: User-Centric LoRA Watermarking for Text-to-Image Diffusion Models
Wang, Yaopeng
Wang, Qingliang
Wang, Zhibo
Xu, Huiyu
Du, Jiacheng
Wang, Qiu
Yin, Jia-Li
Ren, Kui
Cryptography and Security
Low-Rank Adaptation (LoRA) has become a widely used mechanism for customizing text-to-image diffusion models, enabling lightweight modules that are shared, reused, and commercialized as independent assets. This LoRA-centric ecosystem shifts copyright protection from foundation models to distributed LoRA modules, which are easy to copy, redistribute, or reuse without authorization. Existing watermarking methods either protect the base diffusion model or require watermark-aware retraining for each target LoRA, limiting their practicality in open community settings. To address this limitation, we propose LoRA-Key, a user-centric LoRA watermarking framework that treats copyright protection as a reusable ownership key. LoRA-Key encapsulates a recoverable secret message into a standalone user-specific Watermark LoRA, which can be attached to different target LoRAs through training-free linear superposition without per-LoRA retraining or structural modification. To train such a reusable key, we first establish a latent watermark prior in the frozen VAE latent space for robust message embedding and recovery, and then optimize the Watermark LoRA with message-conditioned watermark supervision and semantic consistency constraints. We further introduce Gradient Orthogonal Projection (GOP) to suppress watermark updates that conflict with semantic-preserving directions, reducing interference with generation fidelity and downstream style adaptation. Extensive experiments show that LoRA-Key provides lightweight plug-and-play copyright protection while preserving generation quality and style fidelity, and maintains robust ownership verification under image-level distortions, downstream fine-tuning, and multi-LoRA composition.
title LoRA-Key: User-Centric LoRA Watermarking for Text-to-Image Diffusion Models
topic Cryptography and Security
url https://arxiv.org/abs/2605.29569