Pose-Free Omnidirectional Gaussian Splatting for 360-Degree Videos with Consistent Depth Priors

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhuang, Chuanqing, Lu, Xin, Deng, Zehui, Lu, Zhengda, Wang, Yiqun, Diao, Junqi, Xiao, Jun
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914424178081792
author Zhuang, Chuanqing
Lu, Xin
Deng, Zehui
Lu, Zhengda
Wang, Yiqun
Diao, Junqi
Xiao, Jun
author_facet Zhuang, Chuanqing
Lu, Xin
Deng, Zehui
Lu, Zhengda
Wang, Yiqun
Diao, Junqi
Xiao, Jun
contents Omnidirectional 3D Gaussian Splatting with panoramas is a key technique for 3D scene representation, and existing methods typically rely on slow SfM to provide camera poses and sparse points priors. In this work, we propose a pose-free omnidirectional 3DGS method, named PFGS360, that reconstructs 3D Gaussians from unposed omnidirectional videos. To achieve accurate camera pose estimation, we first construct a spherical consistency-aware pose estimation module, which recovers poses by establishing consistent 2D-3D correspondences between the reconstructed Gaussians and the unposed images using Gaussians' internal depth priors. Besides, to enhance the fidelity of novel view synthesis, we introduce a depth-inlier-aware densification module to extract depth inliers and Gaussian outliers with consistent monocular depth priors, enabling efficient Gaussian densification and achieving photorealistic novel view synthesis. The experiments show significant outperformance over existing pose-free and pose-aware 3DGS methods on both real-world and synthetic 360-degree videos. Code is available at https://github.com/zcq15/PFGS360.
format Preprint
id arxiv_https___arxiv_org_abs_2603_23324
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Pose-Free Omnidirectional Gaussian Splatting for 360-Degree Videos with Consistent Depth Priors
Zhuang, Chuanqing
Lu, Xin
Deng, Zehui
Lu, Zhengda
Wang, Yiqun
Diao, Junqi
Xiao, Jun
Computer Vision and Pattern Recognition
Omnidirectional 3D Gaussian Splatting with panoramas is a key technique for 3D scene representation, and existing methods typically rely on slow SfM to provide camera poses and sparse points priors. In this work, we propose a pose-free omnidirectional 3DGS method, named PFGS360, that reconstructs 3D Gaussians from unposed omnidirectional videos. To achieve accurate camera pose estimation, we first construct a spherical consistency-aware pose estimation module, which recovers poses by establishing consistent 2D-3D correspondences between the reconstructed Gaussians and the unposed images using Gaussians' internal depth priors. Besides, to enhance the fidelity of novel view synthesis, we introduce a depth-inlier-aware densification module to extract depth inliers and Gaussian outliers with consistent monocular depth priors, enabling efficient Gaussian densification and achieving photorealistic novel view synthesis. The experiments show significant outperformance over existing pose-free and pose-aware 3DGS methods on both real-world and synthetic 360-degree videos. Code is available at https://github.com/zcq15/PFGS360.
title Pose-Free Omnidirectional Gaussian Splatting for 360-Degree Videos with Consistent Depth Priors
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.23324