No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huang, Ranran, Mikolajczyk, Krystian
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917158859046912
author Huang, Ranran
Mikolajczyk, Krystian
author_facet Huang, Ranran
Mikolajczyk, Krystian
contents We introduce SPFSplat, an efficient framework for 3D Gaussian splatting from sparse multi-view images, requiring no ground-truth poses during training or inference. It employs a shared feature extraction backbone, enabling simultaneous prediction of 3D Gaussian primitives and camera poses in a canonical space from unposed inputs within a single feed-forward step. Alongside the rendering loss based on estimated novel-view poses, a reprojection loss is integrated to enforce the learning of pixel-aligned Gaussian primitives for enhanced geometric constraints. This pose-free training paradigm and efficient one-step feed-forward design make SPFSplat well-suited for practical applications. Remarkably, despite the absence of pose supervision, SPFSplat achieves state-of-the-art performance in novel view synthesis even under significant viewpoint changes and limited image overlap. It also surpasses recent methods trained with geometry priors in relative pose estimation. Code and trained models are available on our project page: https://ranrhuang.github.io/spfsplat/.
format Preprint
id arxiv_https___arxiv_org_abs_2508_01171
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views
Huang, Ranran
Mikolajczyk, Krystian
Computer Vision and Pattern Recognition
We introduce SPFSplat, an efficient framework for 3D Gaussian splatting from sparse multi-view images, requiring no ground-truth poses during training or inference. It employs a shared feature extraction backbone, enabling simultaneous prediction of 3D Gaussian primitives and camera poses in a canonical space from unposed inputs within a single feed-forward step. Alongside the rendering loss based on estimated novel-view poses, a reprojection loss is integrated to enforce the learning of pixel-aligned Gaussian primitives for enhanced geometric constraints. This pose-free training paradigm and efficient one-step feed-forward design make SPFSplat well-suited for practical applications. Remarkably, despite the absence of pose supervision, SPFSplat achieves state-of-the-art performance in novel view synthesis even under significant viewpoint changes and limited image overlap. It also surpasses recent methods trained with geometry priors in relative pose estimation. Code and trained models are available on our project page: https://ranrhuang.github.io/spfsplat/.
title No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.01171