Uncertainty-Aware 4D Gaussian Splatting for Monocular Occluded Human Rendering

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wang, Weiquan, Shao, Feifei, Li, Lin, Wang, Zhen, Xiao, Jun, Chen, Long
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915911288487936
author Wang, Weiquan
Shao, Feifei
Li, Lin
Wang, Zhen
Xiao, Jun
Chen, Long
author_facet Wang, Weiquan
Shao, Feifei
Li, Lin
Wang, Zhen
Xiao, Jun
Chen, Long
contents High-fidelity rendering of dynamic humans from monocular videos typically degrades catastrophically under occlusions. Existing solutions incorporate external priors-either hallucinating missing content via generative models, which induces severe temporal flickering, or imposing rigid geometric heuristics that fail to capture diverse appearances. To this end, we reformulate the task as a Maximum A Posteriori estimation problem under heteroscedastic observation noise. In this paper, we propose U-4DGS, a framework integrating a Probabilistic Deformation Network and a Joint Rasterization pipeline. This architecture renders pixel-aligned uncertainty maps that act as an adaptive gradient modulator, automatically attenuating artifacts from unreliable observations. Furthermore, to prevent geometric drift in regions lacking reliable visual cues, we enforce Confidence-Aware Regularizations, which leverage the learned uncertainty to selectively propagate spatial-temporal validity. Extensive experiments on the ZJU-MoCap and OcMotion datasets demonstrate that U-4DGS achieves state-of-the-art rendering fidelity and robustness.
format Preprint
id arxiv_https___arxiv_org_abs_2602_06343
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Uncertainty-Aware 4D Gaussian Splatting for Monocular Occluded Human Rendering
Wang, Weiquan
Shao, Feifei
Li, Lin
Wang, Zhen
Xiao, Jun
Chen, Long
Computer Vision and Pattern Recognition
High-fidelity rendering of dynamic humans from monocular videos typically degrades catastrophically under occlusions. Existing solutions incorporate external priors-either hallucinating missing content via generative models, which induces severe temporal flickering, or imposing rigid geometric heuristics that fail to capture diverse appearances. To this end, we reformulate the task as a Maximum A Posteriori estimation problem under heteroscedastic observation noise. In this paper, we propose U-4DGS, a framework integrating a Probabilistic Deformation Network and a Joint Rasterization pipeline. This architecture renders pixel-aligned uncertainty maps that act as an adaptive gradient modulator, automatically attenuating artifacts from unreliable observations. Furthermore, to prevent geometric drift in regions lacking reliable visual cues, we enforce Confidence-Aware Regularizations, which leverage the learned uncertainty to selectively propagate spatial-temporal validity. Extensive experiments on the ZJU-MoCap and OcMotion datasets demonstrate that U-4DGS achieves state-of-the-art rendering fidelity and robustness.
title Uncertainty-Aware 4D Gaussian Splatting for Monocular Occluded Human Rendering
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.06343