DiffStyle3D: Consistent 3D Gaussian Stylization via Attention Optimization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Yitong, Liu, Xuexin, Wang, Yinglin, Wang, Jing, Dou, Hao, Wang, Changshuo, He, Shuting
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914283774803968
author Yang, Yitong
Liu, Xuexin
Wang, Yinglin
Wang, Jing
Dou, Hao
Wang, Changshuo
He, Shuting
author_facet Yang, Yitong
Liu, Xuexin
Wang, Yinglin
Wang, Jing
Dou, Hao
Wang, Changshuo
He, Shuting
contents 3D style transfer enables the creation of visually expressive 3D content, enriching the visual appearance of 3D scenes and objects. However, existing VGG- and CLIP-based methods struggle to model multi-view consistency within the model itself, while diffusion-based approaches can capture such consistency but rely on denoising directions, leading to unstable training. To address these limitations, we propose DiffStyle3D, a novel diffusion-based paradigm for 3DGS style transfer that directly optimizes in the latent space. Specifically, we introduce an Attention-Aware Loss that performs style transfer by aligning style features in the self-attention space, while preserving original content through content feature alignment. Inspired by the geometric invariance of 3D stylization, we propose a Geometry-Guided Multi-View Consistency method that integrates geometric information into self-attention to enable cross-view correspondence modeling. Based on geometric information, we additionally construct a geometry-aware mask to prevent redundant optimization in overlapping regions across views, which further improves multi-view consistency. Extensive experiments show that DiffStyle3D outperforms state-of-the-art methods, achieving higher stylization quality and visual realism.
format Preprint
id arxiv_https___arxiv_org_abs_2601_19717
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle DiffStyle3D: Consistent 3D Gaussian Stylization via Attention Optimization
Yang, Yitong
Liu, Xuexin
Wang, Yinglin
Wang, Jing
Dou, Hao
Wang, Changshuo
He, Shuting
Computer Vision and Pattern Recognition
3D style transfer enables the creation of visually expressive 3D content, enriching the visual appearance of 3D scenes and objects. However, existing VGG- and CLIP-based methods struggle to model multi-view consistency within the model itself, while diffusion-based approaches can capture such consistency but rely on denoising directions, leading to unstable training. To address these limitations, we propose DiffStyle3D, a novel diffusion-based paradigm for 3DGS style transfer that directly optimizes in the latent space. Specifically, we introduce an Attention-Aware Loss that performs style transfer by aligning style features in the self-attention space, while preserving original content through content feature alignment. Inspired by the geometric invariance of 3D stylization, we propose a Geometry-Guided Multi-View Consistency method that integrates geometric information into self-attention to enable cross-view correspondence modeling. Based on geometric information, we additionally construct a geometry-aware mask to prevent redundant optimization in overlapping regions across views, which further improves multi-view consistency. Extensive experiments show that DiffStyle3D outperforms state-of-the-art methods, achieving higher stylization quality and visual realism.
title DiffStyle3D: Consistent 3D Gaussian Stylization via Attention Optimization
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.19717