Splats in Splats: Robust and Effective 3D Steganography towards Gaussian Splatting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Guo, Yijia, Huang, Wenkai, Li, Yang, Li, Gaolei, Zhang, Hang, Hu, Liwen, Li, Jianhua, Huang, Tiejun, Ma, Lei
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912725484961792
author Guo, Yijia
Huang, Wenkai
Li, Yang
Li, Gaolei
Zhang, Hang
Hu, Liwen
Li, Jianhua
Huang, Tiejun
Ma, Lei
author_facet Guo, Yijia
Huang, Wenkai
Li, Yang
Li, Gaolei
Zhang, Hang
Hu, Liwen
Li, Jianhua
Huang, Tiejun
Ma, Lei
contents 3D Gaussian splatting (3DGS) has demonstrated impressive 3D reconstruction performance with explicit scene representations. Given the widespread application of 3DGS in 3D reconstruction and generation tasks, there is an urgent need to protect the copyright of 3DGS assets. However, existing copyright protection techniques for 3DGS overlook the usability of 3D assets, posing challenges for practical deployment. Here we describe splats in splats, the first 3DGS steganography framework that embeds 3D content in 3DGS itself without modifying any attributes. To achieve this, we take a deep insight into spherical harmonics (SH) and devise an importance-graded SH coefficient encryption strategy to embed the hidden SH coefficients. Furthermore, we employ a convolutional autoencoder to establish a mapping between the original Gaussian primitives' opacity and the hidden Gaussian primitives' opacity. Extensive experiments indicate that our method significantly outperforms existing 3D steganography techniques, with 5.31% higher scene fidelity and 3x faster rendering speed, while ensuring security, robustness, and user experience.
format Preprint
id arxiv_https___arxiv_org_abs_2412_03121
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Splats in Splats: Robust and Effective 3D Steganography towards Gaussian Splatting
Guo, Yijia
Huang, Wenkai
Li, Yang
Li, Gaolei
Zhang, Hang
Hu, Liwen
Li, Jianhua
Huang, Tiejun
Ma, Lei
Computer Vision and Pattern Recognition
Image and Video Processing
3D Gaussian splatting (3DGS) has demonstrated impressive 3D reconstruction performance with explicit scene representations. Given the widespread application of 3DGS in 3D reconstruction and generation tasks, there is an urgent need to protect the copyright of 3DGS assets. However, existing copyright protection techniques for 3DGS overlook the usability of 3D assets, posing challenges for practical deployment. Here we describe splats in splats, the first 3DGS steganography framework that embeds 3D content in 3DGS itself without modifying any attributes. To achieve this, we take a deep insight into spherical harmonics (SH) and devise an importance-graded SH coefficient encryption strategy to embed the hidden SH coefficients. Furthermore, we employ a convolutional autoencoder to establish a mapping between the original Gaussian primitives' opacity and the hidden Gaussian primitives' opacity. Extensive experiments indicate that our method significantly outperforms existing 3D steganography techniques, with 5.31% higher scene fidelity and 3x faster rendering speed, while ensuring security, robustness, and user experience.
title Splats in Splats: Robust and Effective 3D Steganography towards Gaussian Splatting
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2412.03121