HeadLighter: Disentangling Illumination in Generative 3D Gaussian Heads via Lightstage Captures
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914279646560256 |
|---|---|
| author | Wang, Yating Sun, Yuan Wang, Xuan Yi, Ran Zhou, Boyao Sun, Yipengjing Liu, Hongyu Wang, Yinuo Ma, Lizhuang |
| author_facet | Wang, Yating Sun, Yuan Wang, Xuan Yi, Ran Zhou, Boyao Sun, Yipengjing Liu, Hongyu Wang, Yinuo Ma, Lizhuang |
| contents | Recent 3D-aware head generative models based on 3D Gaussian Splatting achieve real-time, photorealistic and view-consistent head synthesis. However, a fundamental limitation persists: the deep entanglement of illumination and intrinsic appearance prevents controllable relighting. Existing disentanglement methods rely on strong assumptions to enable weakly supervised learning, which restricts their capacity for complex illumination. To address this challenge, we introduce HeadLighter, a novel supervised framework that learns a physically plausible decomposition of appearance and illumination in head generative models. Specifically, we design a dual-branch architecture that separately models lighting-invariant head attributes and physically grounded rendering components. A progressive disentanglement training is employed to gradually inject head appearance priors into the generative architecture, supervised by multi-view images captured under controlled light conditions with a light stage setup. We further introduce a distillation strategy to generate high-quality normals for realistic rendering. Experiments demonstrate that our method preserves high-quality generation and real-time rendering, while simultaneously supporting explicit lighting and viewpoint editing. We will publicly release our code and dataset. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_02103 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | HeadLighter: Disentangling Illumination in Generative 3D Gaussian Heads via Lightstage Captures Wang, Yating Sun, Yuan Wang, Xuan Yi, Ran Zhou, Boyao Sun, Yipengjing Liu, Hongyu Wang, Yinuo Ma, Lizhuang Computer Vision and Pattern Recognition Recent 3D-aware head generative models based on 3D Gaussian Splatting achieve real-time, photorealistic and view-consistent head synthesis. However, a fundamental limitation persists: the deep entanglement of illumination and intrinsic appearance prevents controllable relighting. Existing disentanglement methods rely on strong assumptions to enable weakly supervised learning, which restricts their capacity for complex illumination. To address this challenge, we introduce HeadLighter, a novel supervised framework that learns a physically plausible decomposition of appearance and illumination in head generative models. Specifically, we design a dual-branch architecture that separately models lighting-invariant head attributes and physically grounded rendering components. A progressive disentanglement training is employed to gradually inject head appearance priors into the generative architecture, supervised by multi-view images captured under controlled light conditions with a light stage setup. We further introduce a distillation strategy to generate high-quality normals for realistic rendering. Experiments demonstrate that our method preserves high-quality generation and real-time rendering, while simultaneously supporting explicit lighting and viewpoint editing. We will publicly release our code and dataset. |
| title | HeadLighter: Disentangling Illumination in Generative 3D Gaussian Heads via Lightstage Captures |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2601.02103 |