OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarking

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Xuanyu, Tang, Zecheng, Xu, Zhipei, Li, Runyi, Xu, Youmin, Chen, Bin, Gao, Feng, Zhang, Jian
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916644893229056
author Zhang, Xuanyu
Tang, Zecheng
Xu, Zhipei
Li, Runyi
Xu, Youmin
Chen, Bin
Gao, Feng
Zhang, Jian
author_facet Zhang, Xuanyu
Tang, Zecheng
Xu, Zhipei
Li, Runyi
Xu, Youmin
Chen, Bin
Gao, Feng
Zhang, Jian
contents With the rapid growth of generative AI and its widespread application in image editing, new risks have emerged regarding the authenticity and integrity of digital content. Existing versatile watermarking approaches suffer from trade-offs between tamper localization precision and visual quality. Constrained by the limited flexibility of previous framework, their localized watermark must remain fixed across all images. Under AIGC-editing, their copyright extraction accuracy is also unsatisfactory. To address these challenges, we propose OmniGuard, a novel augmented versatile watermarking approach that integrates proactive embedding with passive, blind extraction for robust copyright protection and tamper localization. OmniGuard employs a hybrid forensic framework that enables flexible localization watermark selection and introduces a degradation-aware tamper extraction network for precise localization under challenging conditions. Additionally, a lightweight AIGC-editing simulation layer is designed to enhance robustness across global and local editing. Extensive experiments show that OmniGuard achieves superior fidelity, robustness, and flexibility. Compared to the recent state-of-the-art approach EditGuard, our method outperforms it by 4.25dB in PSNR of the container image, 20.7% in F1-Score under noisy conditions, and 14.8% in average bit accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2412_01615
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarking
Zhang, Xuanyu
Tang, Zecheng
Xu, Zhipei
Li, Runyi
Xu, Youmin
Chen, Bin
Gao, Feng
Zhang, Jian
Computer Vision and Pattern Recognition
With the rapid growth of generative AI and its widespread application in image editing, new risks have emerged regarding the authenticity and integrity of digital content. Existing versatile watermarking approaches suffer from trade-offs between tamper localization precision and visual quality. Constrained by the limited flexibility of previous framework, their localized watermark must remain fixed across all images. Under AIGC-editing, their copyright extraction accuracy is also unsatisfactory. To address these challenges, we propose OmniGuard, a novel augmented versatile watermarking approach that integrates proactive embedding with passive, blind extraction for robust copyright protection and tamper localization. OmniGuard employs a hybrid forensic framework that enables flexible localization watermark selection and introduces a degradation-aware tamper extraction network for precise localization under challenging conditions. Additionally, a lightweight AIGC-editing simulation layer is designed to enhance robustness across global and local editing. Extensive experiments show that OmniGuard achieves superior fidelity, robustness, and flexibility. Compared to the recent state-of-the-art approach EditGuard, our method outperforms it by 4.25dB in PSNR of the container image, 20.7% in F1-Score under noisy conditions, and 14.8% in average bit accuracy.
title OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarking
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.01615