COSY: Compositional 3DGS Synthesis for Disentangled Human Head Editing

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Barthel, Florian, De Mello, Shalini, Nagano, Koki, Morgenstern, Wieland, Hilsmann, Anna, Eisert, Peter
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913157815992320
author Barthel, Florian
De Mello, Shalini
Nagano, Koki
Morgenstern, Wieland
Hilsmann, Anna
Eisert, Peter
author_facet Barthel, Florian
De Mello, Shalini
Nagano, Koki
Morgenstern, Wieland
Hilsmann, Anna
Eisert, Peter
contents Recent 3D Gaussian Splatting (3DGS) GANs for human heads synthesize and render photorealistic 3D models in real-time and offer a vast variety in identity and appearance. However, controlling specific semantic attributes such as hair color or glasses remains challenging, as edits in the entangled latent space often induce unintended changes in identity or appearance. Although there are several methods that aim to disentangle the latent space post training by estimating directions that only modify certain features, these methods cannot guarantee complete disentanglement and often require pre-trained classifiers. In our approach, we propose a new generator architecture that synthesizes components, such as hair, skin, glasses, and torso, completely independently. This allows for changing the latent vector for one region while keeping the remaining parts fixed. Further, we achieve this separation using only sparse information such as the hair or skin color, eliminating the requirement of segmentation masks or geometric priors, often seen in prior work. To ensure matching shape and lighting conditions during editing, we allow minimal shared information via context tokens between the independent generators. These tokens even allow us to control the shape and light, without any prior annotation. Compared to existing works on GAN-based generation and editing, our method shows better disentanglement, more precise editing control, and competitive visual quality.
format Preprint
id arxiv_https___arxiv_org_abs_2605_24114
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle COSY: Compositional 3DGS Synthesis for Disentangled Human Head Editing
Barthel, Florian
De Mello, Shalini
Nagano, Koki
Morgenstern, Wieland
Hilsmann, Anna
Eisert, Peter
Computer Vision and Pattern Recognition
Recent 3D Gaussian Splatting (3DGS) GANs for human heads synthesize and render photorealistic 3D models in real-time and offer a vast variety in identity and appearance. However, controlling specific semantic attributes such as hair color or glasses remains challenging, as edits in the entangled latent space often induce unintended changes in identity or appearance. Although there are several methods that aim to disentangle the latent space post training by estimating directions that only modify certain features, these methods cannot guarantee complete disentanglement and often require pre-trained classifiers. In our approach, we propose a new generator architecture that synthesizes components, such as hair, skin, glasses, and torso, completely independently. This allows for changing the latent vector for one region while keeping the remaining parts fixed. Further, we achieve this separation using only sparse information such as the hair or skin color, eliminating the requirement of segmentation masks or geometric priors, often seen in prior work. To ensure matching shape and lighting conditions during editing, we allow minimal shared information via context tokens between the independent generators. These tokens even allow us to control the shape and light, without any prior annotation. Compared to existing works on GAN-based generation and editing, our method shows better disentanglement, more precise editing control, and competitive visual quality.
title COSY: Compositional 3DGS Synthesis for Disentangled Human Head Editing
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2605.24114